mlsanityData to 14 Oct 2026

Learned Image Compression for Vision-Language-Action Models

arXiv 2606.16253 ↗First posted 15 Jun 2026cs.CV cs.AIcited by 1

On the map: Vision-language-action models → Efficient VLA inference and adaptation

Abstract (arXiv)

Vision-language-action (VLA) models increasingly rely on high-frequency multi-camera observations, making visual communication a major bottleneck for real-time robotic control in bandwidth-constrained or distributed deployment settings. Existing image and video codecs, however, are designed to preserve generic visual fidelity rather than the control performance of downstream VLA policies. In this work, we introduce SPARC (SPatially Adaptive Rate Control), a learned image compression framework tailored for VLA-driven robots. Our key observation is that the importance of visual information varies substantially across both camera views and spatial regions within an image. Based on this observation, SPARC employs a lightweight temporal mask selector that adaptively allocates bitrate over latent representations according to task relevance while leveraging temporal context. We further introduce a tilted rate loss that stabilizes training by reducing the tendency of entropy-based objectives to over-suppress rare yet task-critical visual patterns. Experiments on diverse robotic benchmarks, including RoboCasa365, VLABench, and LIBERO, show that SPARC consistently achieves stronger control performance than conventional image/video codecs and recent learned compression methods under the same bitrate budget. We additionally demonstrate real-world deployment benefits in remote-control settings, where our method substantially improves the bitrate-success tradeoff.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 31 of its 39 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

31 of 39 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Caching4 Feb

Other references · 30

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  2. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  6. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  9. 2018Variational image compression with a scale hyperpriorcited by 935
  10. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  11. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
  12. 2016End-to-end Optimized Image Compressioncited by 696
18 more
  1. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 664
  2. 2020High-Fidelity Generative Image Compressioncited by 338
  3. 2016Full Resolution Image Compression with Recurrent Neural Networkscited by 175
  4. 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 175
  5. 2015Variable Rate Image Compression with Recurrent Neural Networkscited by 173
  6. 2022Lossy Image Compression with Conditional Diffusion Modelscited by 170
  7. 2019Variable Rate Deep Image Compression With a Conditional Autoencodercited by 114
  8. 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 94
  9. 2020Video Coding for Machines: A Paradigm of Collaborative Compression and Intelligent Analyticscited by 80
  10. 2025Towards Practical Real-Time Neural Video Compressioncited by 80
  11. 2022An Introduction to Neural Data Compressioncited by 79
  12. 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 79
  13. 2021Variable-Rate Deep Image Compression through Spatially-Adaptive Feature Transformcited by 58
  14. 2021Learned Image Coding for Machines: A Content-Adaptive Approachcited by 21
  15. 2025Learned Image Compression with Hierarchical Progressive Context Modelingcited by 21
  16. 2022Selective compression learning of latent representations for variable-rate image compressioncited by 17
  17. 2024Image Coding for Machines with Edge Information Learning Using Segment Anythingcited by 17
  18. 2025Diff-ICMH: Harmonizing Machine and Human Vision in Image Compression with Generative Priorcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think
  2. 2025RLRC: Reinforcement Learning-based Recovery for Compressed Vision-Language-Action Models
  3. 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation
  4. 2025Compressor-VLA: Instruction-Guided Visual Token Compression for Efficient Robotic Manipulation
  5. 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
  6. 2026Reducing Temporal Redundancy for Efficient Vision-Language-Action Inference
  7. 2026Mitigating State Aliasing in Vision-Language-Action Models via Inverse Dynamics Learning
  8. 2025KV-Efficient VLA: A Method to Speed up Vision Language Models with RNN-Gated Chunked KV Cache