{"data":{"kind":"file","path":"README.md","version_id":"tb8t6fmc5y6ym3sur9pjgia9","entry":{"name":"README.md","path":"README.md","is_directory":false,"size":946,"modified_at":"2025-09-09T21:46:08.408000","content_hash":"5589be7e19b943b2f4b887479999bf4a38ef4305311cc7453b6753cccdfe5847"},"entries":[],"content":"# gridsize\r\n\r\n### Overview\r\n- **Environment ID**: `gridsize`\r\n- **Short description**: Tests the models' ability to count grid dimensions in an image.\r\n- **Tags**: multimodal,train\r\n\r\n### Datasets\r\n- **Primary dataset(s)**: gridsize\r\n- **Source links**: https://huggingface.co/datasets/camelCase12/gridsize\r\n- **Split sizes**: 100\r\n\r\n### Task\r\n- **Type**: single-turn\r\n- **Parser**: extract_boxed_answer\r\n- **Rubric overview**: Rewarded by manhattan distance from correct dimensions.\r\n\r\n### Quickstart\r\nRun an evaluation with default settings:\r\n\r\n```bash\r\nuv run vf-eval gridsize\r\n```\r\n\r\nConfigure model and sampling:\r\n\r\n```bash\r\nuv run vf-eval gridsize   -m gpt-4.1-mini   -n 20 -r 3 -t 1024 -T 0.7\r\n```\r\n\r\n### Metrics\r\nSummarize key metrics your rubric emits and how they’re interpreted.\r\n\r\n| Metric | Meaning |\r\n| ------ | ------- |\r\n| `reward` | Main scalar reward (weighted sum of criteria) |\r\n| `accuracy` | Exact match on target answer |","encoding":"utf-8","truncated":false,"total_bytes":946},"status":null}