{"data":{"kind":"file","path":"README.md","version_id":"qon3wj5nz2zuee5th8q0rr22","entry":{"name":"README.md","path":"README.md","is_directory":false,"size":1694,"modified_at":"2026-03-09T19:10:36.567000","content_hash":"2c3334b8a9f8b4c5ed0b8133dea1c72f45bc2f3410582b76e0e525b8c82086b4"},"entries":[],"content":"# contract-clause-review\n\nThis environment tests an agent's ability to review legal contracts, identify specific clauses, and assess their compliance with predefined legal standards or client instructions. It requires sequential analysis and decision-making based on document content and legal tools.\n\n## Overview\n\n**Domain**: law\n**Base Class**: StatefulToolEnv\n**Difficulty**: medium\n**Task**: The model must review a given contract, identify clauses related to a specific legal topic (e.g., liability, termination), and determine if they meet specified legal requirements or client preferences using provided legal tools.\n\n## Quickstart\n\n### Installation\n\n```bash\nuv run vf-install contract-clause-review\n```\n\n### Usage\n\n```python\nimport verifiers as vf\n\nenv = vf.load_environment(\"contract-clause-review\")\nresults = env.evaluate_sync(\n    client=vf.OpenAI(),\n    model=\"gpt-4.1-mini\",\n    num_examples=10,\n    rollouts_per_example=1\n)\n```\n\n### Evaluation\n\nRun an evaluation with default settings:\n\n```bash\nuv run vf-eval contract-clause-review\n```\n\nConfigure model and sampling:\n\n```bash\nuv run vf-eval contract-clause-review \\\n  -m gpt-4.1-mini \\\n  -n 20 -r 3 -t 1024 -T 0.7\n```\n\n## Environment Arguments\n\n| Arg | Type | Default | Description |\n|-----|------|---------|-------------|\n| `num_examples` | int | 1000 | Number of training examples |\n| `num_eval_examples` | int | 100 | Number of evaluation examples |\n| `seed` | int | 42 | Random seed for reproducibility |\n\n## Metrics\n\n| Metric | Meaning |\n|--------|---------|\n| `reward` | Primary reward signal |\n| `format_reward` | Format adherence reward (if applicable) |\n\n## About\n\nGenerated by synthetic-rl-env-creator.\n\n**Tags**: law\n","encoding":"utf-8","truncated":false,"total_bytes":1694},"status":null}