Learned Image Compression for Vision-Language-Action Models
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-language-action (VLA) models increasingly rely on high-frequency multi-camera observations, making visual communication a major bottleneck for real-time robotic control in bandwidth-constrained or distributed deployment settings. Existing image and video codecs, however, are designed to preserve generic visual fidelity rather than the control performance of downstream VLA policies. In this work, we introduce SPARC (SPatially Adaptive Rate Control), a learned image compression framework tailored for VLA-driven robots. Our key observation is that the importance of visual information varies substantially across both camera views and spatial regions within an image. Based on this observation, SPARC employs a lightweight temporal mask selector that adaptively allocates bitrate over latent representations according to task relevance while leveraging temporal context. We further introduce a tilted rate loss that stabilizes training by reducing the tendency of entropy-based objectives to over-suppress rare yet task-critical visual patterns. Experiments on diverse robotic benchmarks, including RoboCasa365, VLABench, and LIBERO, show that SPARC consistently achieves stronger control performance than conventional image/video codecs and recent learned compression methods under the same bitrate budget. We additionally demonstrate real-world deployment benefits in remote-control settings, where our method substantially improves the bitrate-success tradeoff.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 31 of its 39 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
31 of 39 references.
Closest ancestors · 1
Same direction, newest first
Other references · 30
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2018Variational image compression with a scale hyperpriorcited by 935
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
- 2016End-to-end Optimized Image Compressioncited by 696
18 more
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 664
- 2020High-Fidelity Generative Image Compressioncited by 338
- 2016Full Resolution Image Compression with Recurrent Neural Networkscited by 175
- 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 175
- 2015Variable Rate Image Compression with Recurrent Neural Networkscited by 173
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 170
- 2019Variable Rate Deep Image Compression With a Conditional Autoencodercited by 114
- 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 94
- 2020Video Coding for Machines: A Paradigm of Collaborative Compression and Intelligent Analyticscited by 80
- 2025Towards Practical Real-Time Neural Video Compressioncited by 80
- 2022An Introduction to Neural Data Compressioncited by 79
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 79
- 2021Variable-Rate Deep Image Compression through Spatially-Adaptive Feature Transformcited by 58
- 2021Learned Image Coding for Machines: A Content-Adaptive Approachcited by 21
- 2025Learned Image Compression with Hierarchical Progressive Context Modelingcited by 21
- 2022Selective compression learning of latent representations for variable-rate image compressioncited by 17
- 2024Image Coding for Machines with Edge Information Learning Using Segment Anythingcited by 17
- 2025Diff-ICMH: Harmonizing Machine and Human Vision in Image Compression with Generative Priorcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think
- 2025RLRC: Reinforcement Learning-based Recovery for Compressed Vision-Language-Action Models
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation
- 2025Compressor-VLA: Instruction-Guided Visual Token Compression for Efficient Robotic Manipulation
- 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
- 2026Reducing Temporal Redundancy for Efficient Vision-Language-Action Inference
- 2026Mitigating State Aliasing in Vision-Language-Action Models via Inverse Dynamics Learning
- 2025KV-Efficient VLA: A Method to Speed up Vision Language Models with RNN-Gated Chunked KV Cache