{"data":{"kind":"file","path":"README.md","version_id":"sqbpeze1vx64a65tsq8bv09f","entry":{"name":"README.md","path":"README.md","is_directory":false,"size":1795,"modified_at":"2026-02-14T22:04:31.387000","content_hash":"5e4ddd77915e3ce09355b13223625f093832888dceb87ce76e66690de29177ef"},"entries":[],"content":"# OpenMed JAMA\n\nExpert-level clinical challenge MCQ environment using JAMA Clinical Challenge cases.\n\n## Task\n\nGiven a JAMA clinical challenge case with a detailed clinical vignette, select the correct answer from 4 options (A-D). These represent some of the hardest clinical reasoning questions available, published in one of the most prestigious medical journals.\n\n## Dataset\n\n- **Source**: [JesseLiu/Jama_challenge](https://huggingface.co/datasets/JesseLiu/Jama_challenge)\n- **Size**: 1,521 expert-level cases (~1,444 train / ~77 eval, 95/5 split)\n- **Format**: Clinical vignette + 4-choice MCQ (A-D)\n- **Splits**: Combined test (1,511) + validation (10), re-split 95/5\n\n## Reward Structure\n\n| Reward Function | Weight | Description |\n|----------------|--------|-------------|\n| accuracy_reward | 80% | Exact match on the final letter (A-D) parsed from `\\boxed{}` |\n| thinking_reward | 15% | Quality of clinical reasoning in `<think>` tags (length-based: 300+ chars=1.0, 150+=0.75, 50+=0.5) |\n| format_reward | 5% | Proper \\boxed{} usage with valid letter (A-D) |\n\n## Example\n\n**Input**: \"JAMA Clinical Challenge: A 45-year-old woman presents with progressive fatigue, weight loss, and hyperpigmentation of the skin and oral mucosa...\"\n\n**Options**:\n- A. Primary adrenal insufficiency\n- B. Secondary adrenal insufficiency\n- C. Cushing syndrome\n- D. Pheochromocytoma\n\n**Expected Output**: `\\boxed{A}`\n\n## Usage\n\n```python\nfrom OpenMed_JAMA import load_environment\n\nenv = load_environment()\nprint(f\"Train: {len(env.dataset)} examples\")\nprint(f\"Eval: {len(env.eval_dataset)} examples\")\n```\n\n## Citation\n\n```bibtex\n@dataset{jama_challenge,\n  title={JAMA Clinical Challenge},\n  author={Liu, Jesse},\n  publisher={Hugging Face},\n  url={https://huggingface.co/datasets/JesseLiu/Jama_challenge}\n}\n```\n","encoding":"utf-8","truncated":false,"total_bytes":1795},"status":null}