mlsanityData to 7 Oct 2026

Revisiting the Travel Planning Capabilities of Large Language Models

arXiv 2605.03308 ↗First posted 5 May 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Travel planning serves as a critical task for long-horizon reasoning, exposing significant deficits in LLMs. However, existing benchmarks and evaluations primarily assess final plans in an end-to-end manner, which lacks interpretability and makes it difficult to analyze the root causes of failures. To bridge this gap, we decompose travel planning into five constituent atomic sub-capabilities, including Constraint Extraction, Tool Use, Plan Generation, Error Identification, and Error Correction. We implement a decoupled evaluation protocol leveraging oracle intermediate contexts to rigorously isolate these components, thereby measuring the atomic performance boundary without the noise of cascading errors. Our results highlight a clear contrast in performance: while LLMs are proficient in extracting explicit constraints, they struggle to infer implicit, open-world requirements. Furthermore, they exhibit structural biases in plan generation and suffer from ineffective self-correction, characterized by excessive sensitivity and erroneous persistence. These findings offer precise directions for improving LLM reasoning and planning abilities.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 33 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

25 of 33 references.

References · 25

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2023A Survey of Large Language Modelscited by 2,537
  4. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  5. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 385
  6. 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 298
  7. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
  8. 2024DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agentscited by 89
  9. 2025Memp: Exploring Agent Procedural Memorycited by 88
  10. 2025Agent Learning via Early Experiencecited by 79
  11. 2024LLM With Tools: A Surveycited by 60
  12. 2024Large Language Models Can Solve Real-World Planning Rigorously with Formal Verification Toolscited by 47
13 more
  1. 2024Planning with Multi-Constraints via Collaborative Language Agentscited by 26
  2. 2025TripTailor: A Real-World Benchmark for Personalized Travel Planningcited by 22
  3. 2024To the Globe (TTG): Towards Language-Driven Guaranteed Travel Planningcited by 21
  4. 2025TripCraft: A Benchmark for Spatio-Temporally Fine Grained Travel Planningcited by 21
  5. 2025DeepTravel: An End-to-End Agentic Reinforcement Learning Framework for Autonomous Travel Planning Agentscited by 17
  6. 2024Interactive Speculative Planning: Enhance Agent Efficiency through Co-design of System and User Interfacecited by 15
  7. 2024ChinaTravel: An Open-Ended Travel Planning Benchmark with Compositional Constraint Validation for Language Agentscited by 15
  8. 2025LabUtopia: High-Fidelity Simulation and Hierarchical Benchmark for Scientific Embodied Agentscited by 14
  9. 2025ATLAS: Constraints-Aware Multi-Agent Collaboration for Real-World Travel Planningcited by 13
  10. 2024A Human-Like Reasoning Framework for Multi-Phases Planning Task with Large Language Modelscited by 12
  11. 2025RETAIL: Towards Real-world Travel Planning for Large Language Modelscited by 9
  12. 2025TripTide: A Benchmark for Adaptive Travel Planning under Disruptionscited by 8
  13. 2025Decompose, Plan in Parallel, and Merge: A Novel Paradigm for Large Language Models based Planning with Multiple Constraintscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Flex-TravelPlanner: A Benchmark for Flexible Planning with Language Agents
  2. 2025Beyond Itinerary Planning-A Real-World Benchmark for Multi-Turn and Tool-Using Travel Tasks
  3. 2024Robust Planning with LLM-Modulo Framework: Case Study in Travel Planning
  4. 2026SokoBench: Evaluating Long-Horizon Planning and Reasoning in Large Language Models
  5. 2024Exploring and Benchmarking the Planning Capabilities of Large Language Models
  6. 2026TREK: A Travel Reasoning and Evaluation Kit for LLM Agents in Complex Trip Planning
  7. 2024Chasing Progress, Not Perfection: Revisiting Strategies for End-to-End LLM Plan Generation
  8. 2025Language Model as Planner and Formalizer under Constraints