mlsanityData to 7 Oct 2026

UAOR: Uncertainty-aware Observation Reinjection for Vision-Language-Action Models

arXiv 2602.18020 ↗First posted 20 Feb 2026cs.CV cs.ROcited by 5

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models leverage pretrained Vision-Language Models (VLMs) as backbones to map images and instructions to actions, demonstrating remarkable potential for generalizable robotic manipulation. To enhance performance, existing methods often incorporate extra observation cues (e.g., depth maps, point clouds) or auxiliary modules (e.g., object detectors, encoders) to enable more precise and reliable task execution, yet these typically require costly data collection and additional training. Inspired by the finding that Feed-Forward Network (FFN) in language models can act as "key-value memory", we propose Uncertainty-aware Observation Reinjection (UAOR), an effective, training-free and plug-and-play module for VLA models. Specifically, when the current language model layer exhibits high uncertainty, measured by Action Entropy, it reinjects key observation information into the next layer's Feed-Forward Network (FFN) through attention retrieval. This mechanism directly augments the hidden states with observation evidence at high-uncertainty layers, enabling more accurate and reliable action generation. Comprehensive experiments show that our method consistently improves diverse VLA models across simulation and real-world tasks with minimal overhead. Notably, UAOR eliminates the need for additional observation cues or modules, making it a versatile and practical plug-in for existing VLA pipelines. The project page is at https://uaor.jiabingyang.cn.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 46 of its 63 references that are in the map. First posted on arXiv 20 Feb 2026.

Builds on

46 of 63 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsification28 Aug
  2. 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models9 Jun
  3. 2025PointVLA: Injecting the 3D World into Vision-Language-Action Models10 Mar
  4. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  5. 2023Vision-Language Foundation Models as Effective Robot Imitators2 Nov
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 40

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  4. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  5. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  6. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  8. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
  9. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  10. 2016Deep Variational Information Bottleneckcited by 915
  11. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  12. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 579
28 more
  1. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  2. 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 540
  3. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  4. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  5. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  6. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  7. 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 367
  8. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  9. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
  10. 2024Latent Action Pretraining from Videoscited by 302
  11. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
  12. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
  13. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
  14. 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulationcited by 79
  15. 2024Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal Large Language Modelscited by 72
  16. 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulationcited by 71
  17. 2025Evo-0: Vision-Language-Action Model with Implicit Spatial Understandingcited by 55
  18. 2025VLAS: Vision-Language-Action Model With Speech Instructions For Customized Robot Manipulationcited by 48
  19. 2024Uncertainty Quantification for In-Context Learning of Large Language Modelscited by 45
  20. 2024VidMan: Exploiting Implicit Dynamics from Video Diffusion Model for Effective Robot Manipulationcited by 45
  21. 2024A Dual Process VLA: Efficient Robotic Manipulation Leveraging VLMcited by 44
  22. 20253D CAVLA: Leveraging Depth and 3D Context to Generalize Vision Language Action Models for Unseen Taskscited by 30
  23. 2024Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuningcited by 20
  24. 2025Evaluating Uncertainty and Quality of Vision-Language-Action-enabled Robotscited by 17
  25. 2025Unveiling the Potential of Vision-Language-Action Models with Open-Ended Multimodal Instructionscited by 12
  26. 2025EC-Flow: Enabling Versatile Robotic Manipulation from Action-Unlabeled Videos via Embodiment-Centric Flowcited by 10
  27. 2025AimBot: A Simple Auxiliary Visual Cue to Enhance Spatial Awareness of Visuomotor Policiescited by 10
  28. 2025IKOD: Mitigating Visual Attention Degradation in Large Vision-Language Modelscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
  2. 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulation
  3. 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts
  4. 2026Grounded Semantic Re-Binding for Robust Instruction Generalization in Vision-Language-Action Models
  5. 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention
  6. 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies
  7. 2026LangForce: Bayesian Decomposition of Vision Language Action Models via Latent Action Queries
  8. 2025Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policy