mlsanityData to 7 Oct 2026

TravelAgent: Generative Agents in the Built Environment

arXiv 2412.18985 ↗First posted 25 Dec 2024cs.AI cs.HCcited by 5

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Understanding human behavior in built environments is critical for designing functional, user centered urban spaces. Traditional approaches, such as manual observations, surveys, and simplified simulations, often fail to capture the complexity and dynamics of real world behavior. To address these limitations, we introduce TravelAgent, a novel simulation platform that models pedestrian navigation and activity patterns across diverse indoor and outdoor environments under varying contextual and environmental conditions. TravelAgent leverages generative agents integrated into 3D virtual environments, enabling agents to process multimodal sensory inputs and exhibit human-like decision-making, behavior, and adaptation. Through experiments, including navigation, wayfinding, and free exploration, we analyze data from 100 simulations comprising 1898 agent steps across diverse spatial layouts and agent archetypes, achieving an overall task completion rate of 76%. Using spatial, linguistic, and sentiment analyses, we show how agents perceive, adapt to, or struggle with their surroundings and assigned tasks. Our findings highlight the potential of TravelAgent as a tool for urban design, spatial cognition research, and agent-based modeling. We discuss key challenges and opportunities in deploying generative agents for the evaluation and refinement of spatial designs, proposing TravelAgent as a new paradigm for simulating and understanding human experiences in built environments.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 83 references that are in the map. First posted on arXiv 25 Dec 2024.

Builds on

23 of 83 references.

References · 23

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  7. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  8. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  9. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  10. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  11. 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 533
  12. 2024Understanding the planning of LLM agents: A surveycited by 414
11 more
  1. 2018Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environmentscited by 238
  2. 2023Gender bias and stereotypes in Large Language Modelscited by 185
  3. 2023Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Modelscited by 144
  4. 2024Large Language Models are Geographically Biasedcited by 91
  5. 2023On Generative Agents in Recommendationcited by 88
  6. 2020A Survey on Deep Learning for Human Mobilitycited by 87
  7. 2024V-IRL: Grounding Virtual Intelligence in Real Lifecited by 35
  8. 2024Text Clustering with Large Language Model Embeddingscited by 27
  9. 2024On the limits of agency in agent-based modelscited by 20
  10. 2023Generative Agent-Based Modeling: Unveiling Social System Dynamics through Coupling Mechanistic Models with Generative Artificial Intelligencecited by 19
  11. 2021An Overview of Agent-based Traffic Simulatorscited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025MobileCity: An Efficient Framework for Large-Scale Urban Behavior Simulation
  2. 2025GATSim: Urban Mobility Simulation with Generative Agents
  3. 2026GTA: Generative Traffic Agents for Simulating Realistic Mobility Behavior
  4. 2026GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation
  5. 2026CityReal: Human-Aligned Urban Behavior and City Dynamics Simulation with Large-Scale LLM Agents
  6. 2026When Plausible Is Not Realistic: Evaluating Human Mobility in LLM-Based Urban Simulation
  7. 2025Modeling realistic human behavior using generative agents in a multimodal transport system: Software architecture and Application to Toulouse
  8. 2025CitySim: Modeling Urban Behaviors and City Dynamics with Large-Scale LLM-Driven Agent Simulation