{"data":{"kind":"file","path":"README.md","version_id":"zhwkw1g6ly0rcbnb36n66u4h","entry":{"name":"README.md","path":"README.md","is_directory":false,"size":2223,"modified_at":"2026-03-27T21:54:23.525000","content_hash":"a04b50ef53d4e171e6bd327fa576615bda42aabaad1ce7cd5602683ae0cf2c30"},"entries":[],"content":"# reverse-text\n\n<a href=\"https://github.com/PrimeIntellect-ai/verifiers/tree/main/environments/reverse_text\">\n<img src=\"https://img.shields.io/badge/GitHub-181717?style=for-the-badge&logo=github&logoColor=white\" alt=\"Source Code\">\n</a>\n\n### Overview\n\n- **Environment ID**: `reverse-text`\n- **Short description**: Reverse a given text; evaluated by LCS similarity between the parsed answer and ground-truth reversal.\n- **Tags**: text, transformation, single-turn, xml\n\n### Datasets\n\n- **Primary dataset(s)**: difficulty-specific TinyStories datasets under `13point5/reverse-text-tinystories-{difficulty}`\n- **Source links**:\n  - [13point5/reverse-text-tinystories-easy](https://huggingface.co/datasets/13point5/reverse-text-tinystories-easy)\n  - [13point5/reverse-text-tinystories-medium](https://huggingface.co/datasets/13point5/reverse-text-tinystories-medium)\n  - [13point5/reverse-text-tinystories-hard](https://huggingface.co/datasets/13point5/reverse-text-tinystories-hard)\n- **Split sizes**: Uses `train` for training and `test` for eval automatically\n\n### Task\n\n- **Type**: single-turn\n- **Rubric overview**: LCS ratio between parsed answer and target reversed text\n\n### Quickstart\n\nRun an evaluation with default settings:\n\n```bash\nprime eval run reverse-text\n```\n\nChoose a difficulty explicitly:\n\n```bash\nprime eval run reverse-text \\\n  -a '{\"difficulty\": \"easy\"}' \\\n  -m openai/gpt-4o-mini \\\n  -n 20 -r 3 -t 1024\n```\n\nNotes:\n\n- Use `-a` / `--env-args` to pass environment-specific configuration as a JSON object.\n\n### Environment Arguments\n\n| Arg          | Type | Default  | Description                                            |\n| ------------ | ---- | -------- | ------------------------------------------------------ |\n| `difficulty` | str  | `\"easy\"` | Difficulty bucket to load: `easy`, `medium`, or `hard` |\n\nThe dataset owner, repo prefix, train/test split mapping, and system prompt are hardcoded in the local environment so `difficulty` is the only dataset-selection argument.\n\n### Metrics\n\n| Metric   | Meaning                                                |\n| -------- | ------------------------------------------------------ |\n| `reward` | LCS similarity between reversed text and parsed answer |\n","encoding":"utf-8","truncated":false,"total_bytes":2223},"status":null}