{"data":{"kind":"file","path":"README.md","version_id":"cn8nrcmyjp1z39bz4i14w5u1","entry":{"name":"README.md","path":"README.md","is_directory":false,"size":1768,"modified_at":"2026-11-17T12:25:14.258000","content_hash":"cd52c805a62e6daeb99f12898942d63cac235a551abc7bdc851a017cefeeb238"},"entries":[],"content":"# swe-rebench-v2-1\n\nRequires `verifiers[harbor]>=0.4.2.dev47`.\n\nSWE-rebench V2.1: 21,272 executable issue-resolving tasks for RL of coding agents, 20 languages, 4,552\nrepositories. 13,337 tasks are re-curated from SWE-rebench V2; 7,935 Python tasks come from the first SWE-rebench,\nrebuilt with new images and the same curation pipeline (tag `swe-rebench-v1`).\n\nEach task pins a public `docker.io/swerebenchv2` image by digest and ships its tests and a standalone grader.\nReward is 1.0 iff every FAIL_TO_PASS and PASS_TO_PASS test passes after the hidden test patch is applied, else 0.0.\nEvery released task scores 1 with the gold patch and 0 with an empty patch.\n\n## Taskset\n\n- **Source:** Harbor Hub [`ibragim-badertdinov/swe-rebench-v2.1-rl@v1.1.0`](https://hub.harborframework.com/datasets/ibragim-badertdinov/swe-rebench-v2.1-rl)\n- **Mirrors:** [HF task folders](https://huggingface.co/datasets/ibragim-bad/SWE-rebench-V2.1-harbor),\n  [HF rows](https://huggingface.co/datasets/ibragim-bad/SWE-rebench-V2.1),\n  [code](https://github.com/SWE-rebench/SWE-rebench-V2)\n- **Size:** 21,272 tasks\n- **Network:** open during the agent phase and grading (dependency installs, grader bootstrap).\n- **Resources:** tasks declare 6 CPU / 24 GB; scale with `--taskset.resource-multiplier`.\n\n## Usage\n\n```bash\nprime env install ibragim-bad/swe-rebench-v2-1\nuv run vf-validate swe-rebench-v2-1 --runtime.type docker --taskset.tasks hoburg__gpkit-791\n```\n\nThe first load downloads the whole Harbor package (~21k task folders) into the Harbor cache.\n`vf-validate` runs the gold check (`solution/solve.sh` then the grader) and the empty-patch check.\n\n## Changelog\n\n- 2026-11-17: Initial taskset: generic Harbor taskset pinned to `swe-rebench-v2.1-rl@v1.1.0`, plus a gold `validate`.\n","encoding":"utf-8","truncated":false,"total_bytes":1768},"status":null}