{"data":{"kind":"file","path":"README.md","version_id":"ad7csig7v1wld354c2qcsy2z","entry":{"name":"README.md","path":"README.md","is_directory":false,"size":2211,"modified_at":"2026-08-08T02:09:54.264000","content_hash":"1437be1f66d97de5f1e61a336c0f611c6095a3bc94027ca0d748a6c7d17f05d6"},"entries":[],"content":"# Travel Itinerary Builder\n\nEvaluate an LLM's ability to generate detailed, practical travel itineraries.\n\n## What It Tests\n\nGiven a travel request (destination, duration, budget, interests), the model must produce a structured day-by-day itinerary with:\n\n- **Day-by-day schedule** with specific times for activities\n- **Budget breakdown** by category (accommodation, food, transport, activities)\n- **Transportation details** between locations and within cities\n- **Accommodation recommendations** with price estimates\n- **Meal suggestions** for each day\n- **Local tips and hidden gems** beyond tourist basics\n\n## Rubric (7 metrics)\n\n| Metric | Weight | What It Checks |\n|--------|--------|----------------|\n| `has_day_sections` | 1.0 | Correct number of day sections matching trip duration |\n| `has_budget_breakdown` | 0.9 | Budget broken into accommodation, food, transport, activities, total |\n| `has_specific_times` | 0.8 | Time-stamped activities (e.g., \"9:00 AM - Visit temple\") |\n| `has_transport_info` | 0.8 | Transportation methods and logistics mentioned |\n| `has_accommodation` | 0.7 | Hotel/lodging recommendations with prices |\n| `has_local_recommendations` | 0.6 | Hidden gems, local tips, cultural notes |\n| `meal_coverage` | 0.5 | Meals suggested for each day of the trip |\n\n## Dataset\n\n10 diverse travel scenarios:\n\n1. **Tokyo** (5 days, $1500, solo, anime + street food)\n2. **Amalfi Coast** (7 days, $5000, couple, honeymoon)\n3. **Bangkok** (3 days, $600, friends, nightlife + temples)\n4. **Vietnam** (10 days, $800, solo, backpacking Hanoi→HCMC)\n5. **Orlando** (4 days, $3000, family with kids, theme parks)\n6. **Patagonia** (6 days, $2500, solo, adventure + hiking)\n7. **Oaxaca** (5 days, $1200, solo, culinary tour)\n8. **Morocco** (8 days, $2000, couple, medinas + desert)\n9. **Singapore** (2 days, $800, solo, business + leisure)\n10. **Iceland** (5 days, $3000, friends, Northern Lights + glaciers)\n\n## Usage\n\n```python\nimport verifiers as vf\n\nenv = vf.load_environment(\"henku/travel-itinerary-builder\")\n# or\nfrom travel_itinerary_builder import load_environment\nenv = load_environment()\n```\n\n## Evaluation\n\n```bash\nprime eval run henku/travel-itinerary-builder -m Qwen/Qwen3.5-0.8B\n```\n","encoding":"utf-8","truncated":false,"total_bytes":2211},"status":null}