TravelAgent: Generative Agents in the Built Environment
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Understanding human behavior in built environments is critical for designing functional, user centered urban spaces. Traditional approaches, such as manual observations, surveys, and simplified simulations, often fail to capture the complexity and dynamics of real world behavior. To address these limitations, we introduce TravelAgent, a novel simulation platform that models pedestrian navigation and activity patterns across diverse indoor and outdoor environments under varying contextual and environmental conditions. TravelAgent leverages generative agents integrated into 3D virtual environments, enabling agents to process multimodal sensory inputs and exhibit human-like decision-making, behavior, and adaptation. Through experiments, including navigation, wayfinding, and free exploration, we analyze data from 100 simulations comprising 1898 agent steps across diverse spatial layouts and agent archetypes, achieving an overall task completion rate of 76%. Using spatial, linguistic, and sentiment analyses, we show how agents perceive, adapt to, or struggle with their surroundings and assigned tasks. Our findings highlight the potential of TravelAgent as a tool for urban design, spatial cognition research, and agent-based modeling. We discuss key challenges and opportunities in deploying generative agents for the evaluation and refinement of spatial designs, proposing TravelAgent as a new paradigm for simulating and understanding human experiences in built environments.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 83 references that are in the map. First posted on arXiv 25 Dec 2024.
Builds on
23 of 83 references.
References · 23
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2024GPT-4o System Cardcited by 4,467
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 533
- 2024Understanding the planning of LLM agents: A surveycited by 414
11 more
- 2018Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environmentscited by 238
- 2023Gender bias and stereotypes in Large Language Modelscited by 185
- 2023Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Modelscited by 144
- 2024Large Language Models are Geographically Biasedcited by 91
- 2023On Generative Agents in Recommendationcited by 88
- 2020A Survey on Deep Learning for Human Mobilitycited by 87
- 2024V-IRL: Grounding Virtual Intelligence in Real Lifecited by 35
- 2024Text Clustering with Large Language Model Embeddingscited by 27
- 2024On the limits of agency in agent-based modelscited by 20
- 2023Generative Agent-Based Modeling: Unveiling Social System Dynamics through Coupling Mechanistic Models with Generative Artificial Intelligencecited by 19
- 2021An Overview of Agent-based Traffic Simulatorscited by 11
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2026Auditing Preferences for Brands and Cultures in LLMscited by 4
- 2025Urban Computing in the Era of Large Language Modelscited by 2
- 2025The LLM Wears Prada: Analysing Gender Bias and Stereotypes through Online Shopping Datacited by 1
- 2026URBAN-SPIN: A street-level bikeability index to inform design implementations in historical city centrescited by 0
- 2026Minimal Local Simulation Foundations for LLM- and VLM-Driven Agents in 2D and 3D Environmentscited by 0
- 2026Minimal Local Simulation Foundations for LLM- and VLM-Driven Agents in 2D and 3D Environments24 Aug 2026
- 2026Auditing Preferences for Brands and Cultures in LLMs18 Mar 2026
- 2026URBAN-SPIN: A street-level bikeability index to inform design implementations in historical city centres30 Jan 2026
- 2025Urban Computing in the Era of Large Language Models2 Apr 2025
- 2025The LLM Wears Prada: Analysing Gender Bias and Stereotypes through Online Shopping Data2 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2025MobileCity: An Efficient Framework for Large-Scale Urban Behavior Simulation
- 2025GATSim: Urban Mobility Simulation with Generative Agents
- 2026GTA: Generative Traffic Agents for Simulating Realistic Mobility Behavior
- 2026GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation
- 2026CityReal: Human-Aligned Urban Behavior and City Dynamics Simulation with Large-Scale LLM Agents
- 2026When Plausible Is Not Realistic: Evaluating Human Mobility in LLM-Based Urban Simulation
- 2025Modeling realistic human behavior using generative agents in a multimodal transport system: Software architecture and Application to Toulouse
- 2025CitySim: Modeling Urban Behaviors and City Dynamics with Large-Scale LLM-Driven Agent Simulation