Revisiting the Travel Planning Capabilities of Large Language Models
Not on the map. Why?
Abstract (arXiv)
Travel planning serves as a critical task for long-horizon reasoning, exposing significant deficits in LLMs. However, existing benchmarks and evaluations primarily assess final plans in an end-to-end manner, which lacks interpretability and makes it difficult to analyze the root causes of failures. To bridge this gap, we decompose travel planning into five constituent atomic sub-capabilities, including Constraint Extraction, Tool Use, Plan Generation, Error Identification, and Error Correction. We implement a decoupled evaluation protocol leveraging oracle intermediate contexts to rigorously isolate these components, thereby measuring the atomic performance boundary without the noise of cascading errors. Our results highlight a clear contrast in performance: while LLMs are proficient in extracting explicit constraints, they struggle to infer implicit, open-world requirements. Furthermore, they exhibit structural biases in plan generation and suffer from ineffective self-correction, characterized by excessive sensitivity and erroneous persistence. These findings offer precise directions for improving LLM reasoning and planning abilities.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 33 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
25 of 33 references.
References · 25
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023A Survey of Large Language Modelscited by 2,537
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 385
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 298
- 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
- 2024DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agentscited by 89
- 2025Memp: Exploring Agent Procedural Memorycited by 88
- 2025Agent Learning via Early Experiencecited by 79
- 2024LLM With Tools: A Surveycited by 60
- 2024Large Language Models Can Solve Real-World Planning Rigorously with Formal Verification Toolscited by 47
13 more
- 2024Planning with Multi-Constraints via Collaborative Language Agentscited by 26
- 2025TripTailor: A Real-World Benchmark for Personalized Travel Planningcited by 22
- 2024To the Globe (TTG): Towards Language-Driven Guaranteed Travel Planningcited by 21
- 2025TripCraft: A Benchmark for Spatio-Temporally Fine Grained Travel Planningcited by 21
- 2025DeepTravel: An End-to-End Agentic Reinforcement Learning Framework for Autonomous Travel Planning Agentscited by 17
- 2024Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interfacecited by 15
- 2024ChinaTravel: An Open-Ended Travel Planning Benchmark with Compositional Constraint Validation for Language Agentscited by 15
- 2025LabUtopia: High-Fidelity Simulation and Hierarchical Benchmark for Scientific Embodied Agentscited by 14
- 2025ATLAS: Constraints-Aware Multi-Agent Collaboration for Real-World Travel Planningcited by 13
- 2024A Human-Like Reasoning Framework for Multi-Phases Planning Task with Large Language Modelscited by 12
- 2025RETAIL: Towards Real-world Travel Planning for Large Language Modelscited by 9
- 2025TripTide: A Benchmark for Adaptive Travel Planning under Disruptionscited by 8
- 2025Decompose, Plan in Parallel, and Merge: A Novel Paradigm for Large Language Models based Planning with Multiple Constraintscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Flex-TravelPlanner: A Benchmark for Flexible Planning with Language Agents
- 2025Beyond Itinerary Planning-A Real-World Benchmark for Multi-Turn and Tool-Using Travel Tasks
- 2024Robust Planning with LLM-Modulo Framework: Case Study in Travel Planning
- 2026SokoBench: Evaluating Long-Horizon Planning and Reasoning in Large Language Models
- 2024Exploring and Benchmarking the Planning Capabilities of Large Language Models
- 2026TREK: A Travel Reasoning and Evaluation Kit for LLM Agents in Complex Trip Planning
- 2024Chasing Progress, Not Perfection: Revisiting Strategies for End-to-End LLM Plan Generation
- 2025Language Model as Planner and Formalizer under Constraints