UrbanAgent: A Tool-Augmented Agent for Cross-System Urban Tasks
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Modern cities rely on an increasing number of digital services to operate, but residents' daily needs are still difficult to meet. Services are fragmented and have little interoperability, placing a heavy operational burden on users. Existing digital platforms, urban foundation models, and intelligent assistants each address only isolated aspects of an urban task. But they struggle to reliably convert complex natural-language requests into executable cross-system workflows. We propose Urban-Agent, a tool-augmented agent framework for cross-system urban tasks. It couples the cognitive and reasoning capabilities of a large language model with a tool-set supporting code execution, API calls, and Model Context Protocol. Through one adaptive closed loop, it clarifies missing information before acting, grounds tool use in live observations, and aligns the final response with observed evidence and task constraints. To address the evaluation gap, we introduce Urban-Eval, a benchmark specifically designed for cross-system urban request. Unlike prior benchmarks that assess either general tool use or urban knowledge and reasoning, Urban-Eval evaluates both task results and execution quality, including required tool coverage, dependency validity, and evidence traceability. Experimental results indicate that Urban-Agent reaches a 71% task success rate, 10 points above the strongest baseline. This lead holds across GPT-5-mini, Gemini-2.5-flash, DeepSeek-V4-flash, and Qwen3-235B-A22B.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 23 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
11 of 23 references.
References · 11
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2023Large Language Models are not Fair Evaluatorscited by 1,050
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 283
- 2024UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarioscited by 28
- 2024CityBench: Evaluating the Capabilities of Large Language Models for Urban Taskscited by 26
- 2025Code2MCP: Transforming Code Repositories into MCP Servicescited by 10
- 2025LocalSearchBench: Benchmarking Agentic Search in Real-World Local Life Servicescited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025AI Urban Scientist: Multi-Agent Collaborative Automation for Urban Research
- 2025USTBench: Benchmarking and Dissecting Spatiotemporal Reasoning of LLMs as Urban Agents
- 2026Multi-Agent Collaborative Reasoning with Tool-Augmented Evidence for Urban Region Profiling
- 2025Large Language Model Powered Intelligent Urban Agents: Concepts, Capabilities, and Applications
- 2026CityBehavEx: A Scalable and Empirically Validated LLM-Assisted Urban Simulation Platform
- 2026DUDA-Bench: Benchmarking LLM Agents on Multimodal Data-Driven Urban Diagnosis
- 2025ThinkGeo: Evaluating Tool-Augmented Agents for Remote Sensing Tasks
- 2026Measuring Decision-Scale Use in Tool-Augmented LLMs: A Contrastive Urban Benchmark ↗