{"data":{"kind":"file","path":"README.md","version_id":"wt8r0urbayi4tj0pvlkomduz","entry":{"name":"README.md","path":"README.md","is_directory":false,"size":1711,"modified_at":"2026-03-09T19:14:59.150000","content_hash":"2aefcfcf8656e7a5dcf3792c8807917cc62649a8f1ed847ad8bbe36060f5d29c"},"entries":[],"content":"# contract-review-clause-identification\n\nThis environment tests an agent's ability to review legal contracts, identify specific clauses based on given criteria, and extract relevant information using a set of legal tools. It evaluates precision in clause identification and data extraction.\n\n## Overview\n\n**Domain**: law\n**Base Class**: StatefulToolEnv\n**Difficulty**: medium\n**Task**: The model must review a provided contract, identify clauses matching a specified type (e.g., 'Force Majeure', 'Confidentiality'), and extract key details from those clauses using available tools.\n\n## Quickstart\n\n### Installation\n\n```bash\nuv run vf-install contract-review-clause-identification\n```\n\n### Usage\n\n```python\nimport verifiers as vf\n\nenv = vf.load_environment(\"contract-review-clause-identification\")\nresults = env.evaluate_sync(\n    client=vf.OpenAI(),\n    model=\"gpt-4.1-mini\",\n    num_examples=10,\n    rollouts_per_example=1\n)\n```\n\n### Evaluation\n\nRun an evaluation with default settings:\n\n```bash\nuv run vf-eval contract-review-clause-identification\n```\n\nConfigure model and sampling:\n\n```bash\nuv run vf-eval contract-review-clause-identification \\\n  -m gpt-4.1-mini \\\n  -n 20 -r 3 -t 1024 -T 0.7\n```\n\n## Environment Arguments\n\n| Arg | Type | Default | Description |\n|-----|------|---------|-------------|\n| `num_examples` | int | 1000 | Number of training examples |\n| `num_eval_examples` | int | 100 | Number of evaluation examples |\n| `seed` | int | 42 | Random seed for reproducibility |\n\n## Metrics\n\n| Metric | Meaning |\n|--------|---------|\n| `reward` | Primary reward signal |\n| `format_reward` | Format adherence reward (if applicable) |\n\n## About\n\nGenerated by synthetic-rl-env-creator.\n\n**Tags**: law\n","encoding":"utf-8","truncated":false,"total_bytes":1711},"status":null}