WorldTravel: A Realistic Multimodal Travel-Planning Benchmark with Tightly Coupled Constraints
Not on the map. Why?
Abstract (arXiv)
Real-world autonomous planning requires coordinating tightly coupled constraints where a single decision dictates the feasibility of all subsequent actions. However, existing benchmarks predominantly feature loosely coupled constraints solvable through local greedy decisions and rely on idealized data, failing to capture the complexity of extracting parameters from dynamic web environments. We introduce WorldTravel, a benchmark comprising 150 real-world travel scenarios across 5 cities that demand navigating an average of 15+ interdependent temporal and logical constraints. To evaluate agents in realistic deployments, we develop WorldTravel-Webscape, a multi-modal environment featuring over 2,000 rendered webpages where agents must perceive constraint parameters directly from visual layouts to inform their planning. Our evaluation of 10 frontier models reveals a significant performance collapse: even the state-of-the-art GPT-5.2 achieves only 32.67% feasibility in text-only settings, which plummets to 19.33% in multi-modal environments. We identify a critical Perception-Action Gap and a Planning Horizon threshold at approximately 10 constraints where model reasoning consistently fails, suggesting that perception and reasoning remain independent bottlenecks. These findings underscore the need for next-generation agents that unify high-fidelity visual perception with long-horizon reasoning to handle brittle real-world logistics.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 18 of its 41 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
18 of 41 references.
References · 18
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 385
6 more
- 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 211
- 2024Simulating Classroom Education with LLM-Empowered Agentscited by 125
- 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
- 2024Large Language Models Can Solve Real-World Planning Rigorously with Formal Verification Toolscited by 47
- 2024TravelAgent: An AI Assistant for Personalized Travel Planningcited by 38
- 2024ITINERA: Integrating Spatial Optimization with Large Language Models for Open-domain Urban Itinerary Planningcited by 33
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026GroupTravelBench: Benchmarking LLM Agents on Multi-Person Travel Planningcited by 5
- 2026PlanningBench: Generating Scalable and Verifiable Planning Data for Evaluating and Training Large Language Modelscited by 1
- 2026ComplexityWorld: Benchmarking Vision-Language Models on Verifiable Visual Decision Makingcited by 0
- 2026ComplexityWorld: Benchmarking Vision-Language Models on Verifiable Visual Decision Making5 Aug 2026
- 2026GroupTravelBench: Benchmarking LLM Agents on Multi-Person Travel Planning24 May 2026
- 2026PlanningBench: Generating Scalable and Verifiable Planning Data for Evaluating and Training Large Language Models20 May 2026