UAOR: Uncertainty-aware Observation Reinjection for Vision-Language-Action Models
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
also in 1 more
Abstract (arXiv)
Vision-Language-Action (VLA) models leverage pretrained Vision-Language Models (VLMs) as backbones to map images and instructions to actions, demonstrating remarkable potential for generalizable robotic manipulation. To enhance performance, existing methods often incorporate extra observation cues (e.g., depth maps, point clouds) or auxiliary modules (e.g., object detectors, encoders) to enable more precise and reliable task execution, yet these typically require costly data collection and additional training. Inspired by the finding that Feed-Forward Network (FFN) in language models can act as "key-value memory", we propose Uncertainty-aware Observation Reinjection (UAOR), an effective, training-free and plug-and-play module for VLA models. Specifically, when the current language model layer exhibits high uncertainty, measured by Action Entropy, it reinjects key observation information into the next layer's Feed-Forward Network (FFN) through attention retrieval. This mechanism directly augments the hidden states with observation evidence at high-uncertainty layers, enabling more accurate and reliable action generation. Comprehensive experiments show that our method consistently improves diverse VLA models across simulation and real-world tasks with minimal overhead. Notably, UAOR eliminates the need for additional observation cues or modules, making it a versatile and practical plug-in for existing VLA pipelines. The project page is at https://uaor.jiabingyang.cn.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 46 of its 63 references that are in the map. First posted on arXiv 20 Feb 2026.
Builds on
46 of 63 references.
Closest ancestors · 6
Same direction, newest first
- 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsification28 Aug
- 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models9 Jun
- 2025PointVLA: Injecting the 3D World into Vision-Language-Action Models10 Mar
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2023Vision-Language Foundation Models as Effective Robot Imitators2 Nov
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 40
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2016Deep Variational Information Bottleneckcited by 915
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 579
28 more
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 540
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 367
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
- 2024Latent Action Pretraining from Videoscited by 302
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
- 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
- 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulationcited by 79
- 2024Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal Large Language Modelscited by 72
- 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulationcited by 71
- 2025Evo-0: Vision-Language-Action Model with Implicit Spatial Understandingcited by 55
- 2025VLAS: Vision-Language-Action Model With Speech Instructions For Customized Robot Manipulationcited by 48
- 2024Uncertainty Quantification for In-Context Learning of Large Language Modelscited by 45
- 2024VidMan: Exploiting Implicit Dynamics from Video Diffusion Model for Effective Robot Manipulationcited by 45
- 2024A Dual Process VLA: Efficient Robotic Manipulation Leveraging VLMcited by 44
- 20253D CAVLA: Leveraging Depth and 3D Context to Generalize Vision Language Action Models for Unseen Taskscited by 30
- 2024Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuningcited by 20
- 2025Evaluating Uncertainty and Quality of Vision-Language-Action-enabled Robotscited by 17
- 2025Unveiling the Potential of Vision-Language-Action Models with Open-Ended Multimodal Instructionscited by 12
- 2025EC-Flow: Enabling Versatile Robotic Manipulation from Action-Unlabeled Videos via Embodiment-Centric Flowcited by 10
- 2025AimBot: A Simple Auxiliary Visual Cue to Enhance Spatial Awareness of Visuomotor Policiescited by 10
- 2025IKOD: Mitigating Visual Attention Degradation in Large Vision-Language Modelscited by 5
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Open-Loop Planning, Closed-Loop Verification: Speculative Verification for VLAcited by 5
- 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Modelscited by 3
- 2026E-TTS: A New Embodied Test-Time Scaling Framework for Robotic Manipulationcited by 1
- 2026ProbeAct: Probe-Guided Training-Free Failure Recovery in Vision-Language-Action Modelscited by 0
- 2026OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoningcited by 0
- 2026OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoning29 Jun 2026
- 2026E-TTS: A New Embodied Test-Time Scaling Framework for Robotic Manipulation25 Jun 2026
- 2026ProbeAct: Probe-Guided Training-Free Failure Recovery in Vision-Language-Action Models8 Jun 2026
- 2026Open-Loop Planning, Closed-Loop Verification: Speculative Verification for VLA3 Apr 2026
- 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models16 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulation
- 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts
- 2026Grounded Semantic Re-Binding for Robust Instruction Generalization in Vision-Language-Action Models
- 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention
- 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies
- 2026LangForce: Bayesian Decomposition of Vision Language Action Models via Latent Action Queries
- 2025Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policy