mlsanityData to 7 Oct 2026

RawVLA: Embodied Neural Image Signal Processor For Robotic Manipulation

arXiv 2609.37530 ↗First posted 29 Sep 2026cs.RO cs.CVcited by 0

On the map: Vision-language-action models → Tactile, force-aware and humanoid VLA also fits: Efficient VLA inference and adaptation

Abstract (arXiv)

Vision-language-action (VLA) models typically operate on RGB images produced by a fixed camera image signal processor (ISP), leaving the imaging pipeline outside the learning and evaluation loop. We systematically examine the consequences of this overlooked design choice across five fundamental ISP dimensions: gain, sensor noise, chromatic response, tonal response, and bit depth. Our analysis reveals that RAW-to-RGB processing materially shapes both action prediction and manipulation success, with different ISP dimensions exerting substantially different effects. Guided by these findings, we introduce RawVLA, a streaming neural ISP that adaptively renders RAW observations for frozen VLA policies while concentrating its capacity on the imaging factors relevant to embodied behavior. We further present RawVLA-Bench, a RAW-domain manipulation benchmark to expose image processing as an explicit evaluation variable across clean and adverse acquisition conditions. Experiments on RawVLA-Bench show that RawVLA preserves performance under standard conditions while substantially improving robustness under degraded imaging, establishing adaptive RAW processing as an effective interface between physical cameras and embodied policies.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Tactile, force-aware and humanoid VLA, one of 13 directions in Vision-language-action models. Builds on 49 of its 60 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

49 of 60 references.

References · 49

  1. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  4. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  9. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  10. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  11. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  12. 2018Learning to See in the Darkcited by 459
37 more
  1. 2026World Action Models are Zero-shot Policiescited by 411
  2. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  3. 2018Unprocessing Images for Learned Raw Denoisingcited by 250
  4. 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 128
  5. 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
  6. 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policycited by 73
  7. 2024VLATest: Testing and Evaluating Vision-Language-Action Models for Robotic Manipulationcited by 43
  8. 2017Dirty Pixels: Towards End-to-End Image Processing and Perceptioncited by 42
  9. 2026Do World Action Models Generalize Better than VLAs? A Robustness Studycited by 35
  10. 2024Run-time Observation Interventions Make Vision-Language-Action Models More Visually Robustcited by 33
  11. 2021ReconfigISP: Reconfigurable Camera Image Processing Pipelinecited by 30
  12. 2022Day-to-Night Image Synthesis for Training Nighttime Neural ISPscited by 23
  13. 2025RobustVLA: On Robustness of Vision-Language-Action Model against Multi-Modal Perturbationscited by 23
  14. 2022GenISP: Neural ISP for Low-Light Machine Cognitioncited by 22
  15. 2019VisionISP: Repurposing the Image Signal Processor for Computer Vision Applicationscited by 18
  16. 2022Rawgment: Noise-Accounted RAW Augmentation Enables Recognition in a Wide Variety of Environmentscited by 18
  17. 2024AdaptiveISP: Learning an Adaptive Image Signal Processor for Object Detectioncited by 18
  18. 2025RobustVLA: Robustness-Aware Reinforcement Post-Training for Vision-Language-Action Modelscited by 16
  19. 2024LADEV: A Language-Driven Testing and Evaluation Platform for Vision-Language-Action Models in Robotic Manipulationcited by 8
  20. 2026STRONG-VLA: Decoupled Robustness Learning for Vision-Language-Action Models under Multimodal Perturbationscited by 8
  21. 2025Dark-ISP: Enhancing RAW Image Processing for Low-Light Object Detectioncited by 5
  22. 2026Safe-Night VLA: Seeing the Unseen via Thermal-Perceptive Vision-Language-Action Models for Safety-Critical Manipulationcited by 5
  23. 2025Beyond RGB: Adaptive Parallel Processing for RAW Object Detectioncited by 4
  24. 2026RADAR: Benchmarking Vision-Language-Action Generalization via Real-World Dynamics, Spatial-Physical Intelligence, and Autonomous Evaluationcited by 4
  25. 2026E-VLA: Event-Augmented Vision-Language-Action Model for Dark and Blurred Scenescited by 4
  26. 2026Improving Robustness of Vision-Language-Action Models by Restoring Corrupted Visual Inputscited by 3
  27. 2026RAWild: Sensor-Agnostic RAW Object Detection via Physics-Guided Curve and Grid Modelingcited by 3
  28. 2026RoVLA: Multi-Consistency Constraints for Robust Vision-Language-Action Modelscited by 3
  29. 2026Colosseum V2: Benchmarking Generalization for Vision-Language-Action Modelscited by 3
  30. 2025RAW-Adapter: Adapting Pre-trained Visual Model to Camera RAW Images and A Benchmarkcited by 2
  31. 2025Task-Aware Image Signal Processor for Advanced Visual Perceptioncited by 2
  32. 2025Embodied Image Compressioncited by 2
  33. 2026Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Modelcited by 2
  34. 2026POS-ISP: Pipeline Optimization at the Sequence Level for Task-aware ISPcited by 1
  35. 2026UniISP: A Unified ISP Framework for Both Human and Machine Visioncited by 1
  36. 2026Learned Image Compression for Vision-Language-Action Modelscited by 1
  37. 2026Lights, Camera, Malfunction: When Illumination Robustness Leaves VLA Models Blind to Colorcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
  2. 2026MuseVLA: An Adaptive Multimodal Sensing Vision-Language-Action Model for Robotic Manipulation
  3. 2025OmniVLA: Physically-Grounded Multimodal VLA with Unified Multi-Sensor Perception for Robotic Manipulation
  4. 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
  5. 2025CronusVLA: Towards Efficient and Robust Manipulation via Multi-Frame Vision-Language-Action Modeling
  6. 2026PhysVLA: Towards Physically-Grounded VLA for Embodied Robotic Manipulation
  7. 2026ReactVLA: Fast and Lightweight Reactive Robot Manipulation via Improved Mean Flow Action Generation
  8. 2025Survey of Vision-Language-Action Models for Embodied Manipulation