mlsanityData to 7 Oct 2026

Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Driving

arXiv 2606.22913 ↗First posted 22 Jun 2026cs.CV cs.AIcited by 2

On the map: Vision-language-action models → VLA for autonomous driving

also in 1 more
Abstract (arXiv)

Recent Vision-Language-Action (VLA) models have advanced end-to-end autonomous driving by incorporating reasoning for better interpretability and planning quality. However, most existing approaches directly generate the final trajectory without explicitly examining its future consequences, which limits their reliability in complex and dynamic environments. To address this limitation, we propose IRR-Drive (Intend, Reflect, Refine), an adaptive multimodal reflection framework for autonomous driving. Specifically, to tightly couple high-level reasoning with physical constraints, IRR-Drive first generates a preliminary textual intention and anticipates potential interactions by predicting future semantic bird's-eye view (BEV) representations. This dual-modality (Text + BEV) reflection space explicitly models anticipated scene evolution, enabling the model to rigorously self-correct and refine its initial intent before generating the final trajectory. Furthermore, to balance planning performance and computational efficiency, we construct reflection-oriented training data and design an adaptive reflection reward, enabling the model to adaptively select its reasoning mode according to scene complexity. Instead of using reasoning primarily as an auxiliary interpretation, IRR-Drive directly integrates an adaptive reflection mechanism into the planning framework, enabling grounded, decision-aware trajectory correction that is driven by scene complexity. Our method achieves state-of-the-art performance on the NAVSIM benchmark in both PDMS and EPDMS. Extensive experiments demonstrate the effectiveness of our multimodal reflection framework and validate the efficacy of the proposed adaptive reflection strategy.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 42 of its 46 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

42 of 46 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving2 Mar
  2. 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failures1 Mar
  3. 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving6 Feb
  4. 2025Counterfactual VLA: Self-Reflective Vision-Language-Action Model with Adaptive Reasoning30 Dec
  5. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
  6. 2025AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Driving2 Sep
  7. 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Driving23 May

Other references · 35

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2017Neural Discrete Representation Learningcited by 4,650
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  5. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  6. 2025Qwen3-VL Technical Reportcited by 2,534
  7. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  8. 2025Group Sequence Policy Optimizationcited by 788
  9. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  10. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  11. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
  12. 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
23 more
  1. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
  2. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
  3. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  4. 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 258
  5. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
  6. 2023LingoQA: Visual Question Answering for Autonomous Drivingcited by 144
  7. 2025Pseudo-Simulation for Autonomous Drivingcited by 141
  8. 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillationcited by 93
  9. 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
  10. 2024Holistic Autonomous Driving Understanding by Bird's-Eye-View Injected Multi-Modal Large Modelscited by 75
  11. 2024Automated Evaluation of Large Vision-Language Models on Self-driving Corner Casescited by 75
  12. 2024Liquid: Language Models are Scalable and Unified Multi-modal Generatorscited by 62
  13. 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 57
  14. 2025ILLUME+: Illuminating Unified MLLM with Dual Visual Tokenization and Diffusion Refinementcited by 53
  15. 2025DriveDPO: Policy Learning via Safety DPO For End-to-End Autonomous Drivingcited by 39
  16. 2024Artemis: Towards Referential Understanding in Complex Videoscited by 25
  17. 2025ReasonPlan: Unified Scene Prediction and Decision Reasoning for Closed-loop Autonomous Drivingcited by 22
  18. 2025SemHiTok: A Unified Image Tokenizer via Semantic-Guided Hierarchical Codebook for Multimodal Understanding and Generationcited by 21
  19. 2025WAM-Flow: Parallel Coarse-to-Fine Motion Planning via Discrete Flow Matching for Autonomous Drivingcited by 15
  20. 2025Xiaomi MiMo-VL-Miloco Technical Reportcited by 15
  21. 2026AutoDrive-P3: Unified Chain of Perception-Prediction-Planning Thought via Reinforcement Fine-Tuningcited by 13
  22. 2025DAP: A Discrete-token Autoregressive Planner for Autonomous Drivingcited by 4
  23. 2026Senna-2: Aligning VLM and End-to-End Driving Policy for Consistent Decision Making and Planningcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Vision-Language-Action World Models for Autonomous Driving
  2. 2026MindDriver: Introducing Progressive Multimodal Reasoning for Autonomous Driving
  3. 2026FactorDrive: Adaptive Multi-Step Reasoning Driven by Planning-Critical Factors for End-to-End Autonomous Driving
  4. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
  5. 2025ImagiDrive: A Unified Imagination-and-Planning Framework for Autonomous Driving
  6. 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving
  7. 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving
  8. 2025Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Driving