mlsanityData to 7 Oct 2026

MapAgent: An Industrial-Grade Agentic Framework for City-scale Lane-level Map Generation

arXiv 2606.04513 ↗First posted 3 Jun 2026cs.AIcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Lane-level maps are critical infrastructure for autonomous driving and lane-level navigation, yet constructing and maintaining standardized lane networks for hundreds of cities remains highly labor-intensive. Recent end-to-end vectorized mapping methods can predict lane geometry and topology directly from sensor data, but they typically treat mapping specifications and traffic regulations as implicit, dataset-dependent supervision. Moreover, in complex scenes (e.g., worn or missing markings and occlusions), correct lane configurations are often under-determined by visual evidence alone, making specification violations a major source of human post-editing. We propose MapAgent, an industrial-grade agentic architecture that augments a vectorization backbone for specification-compliant lane-map production. Rather than merely adding an agent loop to map prediction, MapAgent couples backbone perception with explicit specification verification, constraint-aware reasoning, and deterministic map editing under a bounded, verification-driven Judge-Planner-Worker loop. A vision-language Judge diagnoses errors by jointly inspecting visual evidence and draft vectors, while a tool-calling Planner generates minimal corrective edits with post-edit re-validation. To remain scalable for city-scale production, MapAgent is selectively triggered only on tiles with low backbone confidence, adding modest overhead while preserving throughput. Experiments on real-world datasets show consistent gains over strong production baselines, especially in complex and long-tail scenarios. Additionally, MapAgent has been integrated into Baidu Maps, supporting lane-level map generation for over 360 cities nationwide and elevating the overall production automation to over 95%, demonstrating MapAgent's practicality and effectiveness for large-scale lane-level map generation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 14 of its 33 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

14 of 33 references.

References · 14

  1. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  4. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  5. 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 405
  6. 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 153
  7. 2023Neural Map Prior for Autonomous Drivingcited by 68
  8. 2024P-MapNet: Far-seeing Map Generator Enhanced by both SDMap and HDMap Priorscited by 54
  9. 2023Online Vectorized HD Map Construction using Geometrycited by 42
  10. 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 16
  11. 2025LDMapNet-U: An End-to-End System for City-Scale Lane-Level Map Updatingcited by 8
  12. 2025InteractionMap: Improving Online Vectorized HDMap Construction with Interactioncited by 8
2 more
  1. 2025SDTagNet: Leveraging Text-Annotated Navigation Maps for Online HD Map Constructioncited by 8
  2. 2024DuMapNet: An End-to-End Vectorization System for City-Scale Lane-Level Map Generationcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Driving
  2. 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Driving
  3. 2024SLEDGE: Synthesizing Driving Environments with Generative Models and Rule-Based Traffic
  4. 2025TopoStreamer: Temporal Lane Segment Topology Reasoning in Autonomous Driving
  5. 2026MapDreamer: Aerial Imagery Conditioned Latent Diffusion for Lane-Level Map Generation
  6. 2025Are VLMs Ready for Lane Topology Awareness in Autonomous Driving?
  7. 2025FASTopoWM: Fast-Slow Lane Segment Topology Reasoning with Latent World Models
  8. 2026Bridging Structure and Language: Graph-Based Visual Reasoning for Autonomous Road Understanding