Information Coordination as a Bridge: A Neuro-Symbolic Architecture for Reliable Autonomous Driving Scene Understanding
On the map: End-to-end autonomous driving → Reasoning VLA and VLM driving policies
Abstract (arXiv)
Reliable autonomous driving requires scene understanding that is semantically consistent across heterogeneous sensors and verifiable at the reasoning stage. However, many recent LLM-driven driving systems attach the language model as a post-processor and force it to reason over redundant or conflicting perception outputs, which can amplify hallucinated entities and unsafe conclusions. This paper proposes InfoCoordiBridge, a BEV-centric neuro-symbolic architecture that inserts an explicit coordination bridge between perception and language reasoning. InfoCoordiBridge comprises (i) a unified multi-agent perception layer that outputs typed structured facts together with modality-focused synopses, (ii) an ICA module that aligns and fuses multi-source outputs into a single SceneSummary, and (iii) an SSRE module that performs SceneSummary-grounded reasoning with verification. Experiments on nuScenes and Waymo show that ICA preserves competitive 3D detection accuracy while substantially improving fusion consistency, reducing redundancy to below 1% and achieving about 98% attribute agreement. On NuScenes-QA and a template-aligned Waymo-QA benchmark, SSRE improves factual grounding and reduces hallucinated entity mentions compared with representative VLM and agentic baselines. Overall, by coordinating multi-sensor outputs into a single conflict-aware SceneSummary before prompting, InfoCoordiBridge prevents redundant and cross-modally inconsistent perception evidence from propagating into high-level reasoning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning VLA and VLM driving policies, one of 9 directions in End-to-end autonomous driving. Builds on 45 of its 59 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
45 of 59 references.
Closest ancestors · 1
Same direction, newest first
Other references · 44
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2020Center-based 3D Object Detection and Trackingcited by 1,144
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
32 more
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
- 2023GPT-Driver: Learning to Drive with GPTcited by 347
- 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 262
- 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 207
- 2023A Language Agent for Autonomous Drivingcited by 164
- 2022PolarFormer: Multi-camera 3D Object Detection with Polar Transformercited by 147
- 2023LLM4Drive: A Survey of Large Language Models for Autonomous Drivingcited by 136
- 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectivescited by 122
- 2021SimpleTrack: Understanding and Rethinking 3D Multi-object Trackingcited by 103
- 2023FB-BEV: BEV Representation from Forward-Backward View Transformationscited by 98
- 2023Talk2BEV: Language-enhanced Bird's-eye View Maps for Autonomous Drivingcited by 89
- 2024Holistic Autonomous Driving Understanding by Bird's-Eye-View Injected Multi-Modal Large Modelscited by 76
- 2023Personalized Autonomous Driving with Large Language Models: Field Experimentscited by 48
- 2024PlanAgent: A Multi-modal Large Language Agent for Closed-loop Vehicle Motion Planningcited by 38
- 2025DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understandingcited by 36
- 2025NuScenes-SpatialQA: A Spatial Understanding and Reasoning Benchmark for Vision-Language Models in Autonomous Drivingcited by 35
- 2024GraphBEV: Towards Robust BEV Feature Alignment for Multi-Modal 3D Object Detectioncited by 33
- 2023Poly-MOT: A Polyhedral Framework For 3D Multi-Object Trackingcited by 32
- 2023Fully Sparse Fusion for 3D Object Detectioncited by 29
- 2024DriveGPT: Scaling Autoregressive Behavior Models for Drivingcited by 29
- 2024RAG-based Explainable Prediction of Road Users Behaviors for Automated Driving using Knowledge Graphs and Large Language Modelscited by 20
- 2024Hallucination Detection in Foundation Models for Decision-Making: A Flexible Definition and Review of the State of the Artcited by 17
- 2024Towards Neuro-Symbolic Video Understandingcited by 16
- 2025DriveAgent: Multi-Agent Structured Reasoning with LLM and Multimodal Sensor Fusion for Autonomous Drivingcited by 11
- 2025RoPETR: Improving Temporal Camera-Only 3D Detection by Integrating Enhanced Rotary Position Embeddingcited by 7
- 2025VLDrive: Vision-Augmented Lightweight MLLMs for Efficient Language-grounded Autonomous Drivingcited by 6
- 2024Towards Formal Verification of Deep Neural Networks for Object Detectioncited by 4
- 2025Foundation Models for Autonomous Driving System: An Initial Roadmapcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ALN-P3: Unified Language Alignment for Perception, Prediction, and Planning in Autonomous Driving
- 2025AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving
- 2026From Scene Graphs to Answers: Selective Neuro-Symbolic Reasoning for Autonomous Driving
- 2025V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Driving
- 2026DRIVESPATIAL: A Benchmark for Spatiotemporal Intelligence in VLMs for Autonomous Driving
- 2026KLDrive: Fine-Grained 3D Scene Reasoning for Autonomous Driving based on Knowledge Graph
- 2026Cognitive Dual-Process Planning for Autonomous Driving with Structured Scene Knowledge and Verifiable Reasoning-Action Consistency
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving