{"data":{"kind":"file","path":"README.md","version_id":"kwfruernnguq58mnkts9d7e4","entry":{"name":"README.md","path":"README.md","is_directory":false,"size":1646,"modified_at":"2026-01-28T12:58:44.151000","content_hash":"7fdd95347fca3bb49cc71a7c82ca87518fe8a1ce06f7c7770c19e951d051d219"},"entries":[],"content":"# activity-summary\n\n### Overview\n- **Environment ID**: `activity-summary`\n- **Short description**: Summarize activity event streams into productivity metrics.\n- **Tags**: single-turn, summary, train, eval\n\n### Datasets\n- **Primary dataset(s)**: Synthetic event streams (in-memory).\n- **Source links**: N/A.\n- **Split sizes**: `num_examples` controls dataset size.\n\n### Task\n- **Type**: single-turn\n- **Parser**: JSON parsing\n- **Rubric overview**: Field-level accuracy with numeric tolerance; metrics for JSON validity and exact match.\n\n### Quickstart\nRun an evaluation with default settings:\n\n```bash\nprime env install activity-summary\nprime eval run activity-summary -m openai/gpt-5-nano\n```\n\nConfigure environment args:\n\n```bash\nprime eval run activity-summary -m openai/gpt-5-nano -n 3 -r 1 -a '{\"num_examples\": 3}'\n```\n\nGenerate a larger synthetic dataset:\n\n```bash\npython environments/activity_summary/generate_dataset.py --out environments/activity_summary/data/synthetic.jsonl --num 200\n```\n\nRun evals using the generated dataset:\n\n```bash\nprime eval run activity-summary -m openai/gpt-5-nano -n 50 -r 1 -a '{\"dataset_path\": \"environments/activity_summary/data/synthetic.jsonl\", \"num_examples\": 50}'\n```\n\n### Environment Arguments\n\n| Arg | Type | Default | Description |\n| --- | ---- | ------- | ----------- |\n| `num_examples` | int | `3` | Number of synthetic sessions |\n| `dataset_path` | str | `null` | Path to JSONL dataset with `events` + `answer` |\n\n### Metrics\n\n| Metric | Meaning |\n| ------ | ------- |\n| `reward` | Field-level accuracy (0–1) |\n| `valid_json` | Whether output JSON parsed |\n| `exact_match` | Exact JSON match |\n","encoding":"utf-8","truncated":false,"total_bytes":1646},"status":null}