Lingjing: A Simulation Testbed for Multi-Agent Embodied Tasks in Open-Ended Cities
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Urban embodied intelligence requires coordination among heterogeneous agents (e.g., UAVs, ground robots, and autonomous vehicles) in dynamic cities. Simulators therefore provide a scalable foundation for developing and evaluating such coordination. Existing platforms nevertheless isolate different embodiments and decouple them from task design and evaluation. We present Lingjing, a simulation platform for heterogeneous multi-agent embodied intelligence in open-ended urban environments. Lingjing reconstructs and renders evolving cities from geographic data, synchronizes multiple physics engines, and exposes shared physical and structured urban state to agents. Its Gym-like interface supports user-defined ReAct agents and single- or multi-agent natural-language missions with configurable star or broadcast communication and resource constraints. Each episode becomes an attribution-ready replay that links agent trajectories and communication to relation-graph changes, resource consumption, and engine-based evaluations for systematic diagnosis. We evaluate twelve vision-language models on nine urban tasks under a shared engine-in-the-loop protocol. Controlled studies further examine communication, scalability, robustness, and failure provenance. Results expose persistent bottlenecks in grounding and long-horizon execution. They also show task-dependent coordination trade-offs and diminishing returns from added capacity, while heavier workloads further reduce success. Lingjing provides a unified testbed that enables reproducible end-to-end evaluation and systematic failure diagnosis in urban multi-agent embodied intelligence.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 40 references that are in the map. First posted on arXiv 8 Aug 2026.
Builds on
25 of 40 references.
Closest ancestors · 5
Same direction, newest first
- 2025MobileCity: An Efficient Framework for Large-Scale Urban Behavior Simulation18 Apr
- 2025CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City Space18 Feb
- 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents13 Feb
- 2024EmbodiedCity: A Benchmark Platform for Embodied Agent in Real-world City Environment12 Oct
- 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making9 Oct
Other references · 20
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 281
- 2021TEACh: Task-driven Embodied Agents that Chatcited by 194
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
8 more
- 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 161
- 2020iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenescited by 151
- 2025UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spacescited by 33
- 2025RoboCerebra: A Large-scale Benchmark for Long-horizon Robotic Manipulation Evaluationcited by 31
- 2025Collaborating Action by Action: A Multi-agent LLM Framework for Embodied Reasoningcited by 20
- 2024MetaUrban: An Embodied AI Simulation Platform for Urban Micromobilitycited by 19
- 2025AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoningcited by 19
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Urban Generative Intelligence (UGI): A Foundational Platform for Agents in Embodied City Environment
- 2026ETA: A New Agentic Paradigm for Embodied Tasks
- 2025SimWorld-Robotics: Synthesizing Photorealistic and Dynamic Urban Environments for Multimodal Robot Navigation and Collaboration
- 2026CityBehavEx: A Scalable and Empirically Validated LLM-Assisted Urban Simulation Platform
- 2026Embodied-BenchClaw: An Autonomous Multi-Agent System for Embodied Spatial Intelligence Benchmark Construction
- 2025Generative AI in Embodied Systems: System-Level Analysis of Performance, Efficiency and Scalability
- 2026When Multi-Robot Systems Meet Agentic AI:Towards Embodied Collective Intelligence
- 2025TongSIM: A General Platform for Simulating Intelligent Machines