mlsanityData to 14 Oct 2026

Just Noticeable Difference Modeling for Token Compression in Vision-Language-Action Models

arXiv 2608.21247 ↗First posted 21 Aug 2026cs.CV cs.ROcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

also in 2 more
Abstract (arXiv)

Token compression has become a key technique for reducing the inference cost of large foundation models, with approaches such as token pruning and KV-cache reuse widely adopted in vision-language models and recently explored for embodied agents. In embodied agents, tokens not only support perception and semantic understanding but also directly affect latency-sensitive closed-loop robot action prediction. Existing schemes typically guide compression using redundancy or importance cues, such as visual similarity, attention scores, and saliency. However, these cues only indirectly measure the key factor for safe compression: how much a token can change before causing an unacceptable deviation in downstream actions. This receiver-dependent tolerance is closely related to the principle of just noticeable difference (JND). Classical JND characterizes signal tolerance in the human visual system, while machine-oriented JND extends this concept to downstream machine responses. Building on this progression, we introduce Action-JND, which extends JND modeling to embodied perception by defining noticeability through the language-conditioned action response of a vision-language-action (VLA) policy in closed-loop control. A token change is considered admissible only when the induced action deviation remains within a tolerated margin. To realize this concept, we develop a lightweight token-wise JND estimator in deep visual-feature space to predict the maximum tolerable perturbation while preserving policy responses. The resulting action-tolerance score serves as a plug-and-play criterion for VLA compression paradigms, including stale-KV reuse and token pruning, prioritizing action-tolerant tokens for compression. Experiments on the LIBERO benchmark with OpenVLA and OpenVLA-OFT demonstrate that Action-JND consistently improves compression reliability, especially under aggressive compression ratios.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 36 of its 53 references that are in the map. First posted on arXiv 21 Aug 2026.

Builds on

36 of 53 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 34

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  3. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
  4. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  6. 2022Token Merging: Your ViT But Fastercited by 1,021
  7. 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 880
  8. 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 832
  9. 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
  10. 2024PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funnelingcited by 432
  11. 2024LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Modelscited by 402
  12. 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 391
22 more
  1. 2024VisionZip: Longer is Better but Not Necessary in Vision Language Modelscited by 313
  2. 2025DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Modelscited by 181
  3. 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Modelscited by 93
  4. 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Cachingcited by 86
  5. 2025SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Accelerationcited by 58
  6. 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruningcited by 43
  7. 2024USTC-TD: A Test Dataset and Benchmark for Image and Video Coding in 2020scited by 37
  8. 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruningcited by 36
  9. 2025Action-aware Dynamic Pruning for Efficient Vision-Language-Action Manipulationcited by 34
  10. 2021Just Noticeable Difference for Deep Machine Visioncited by 19
  11. 2021Towards Top-Down Just Noticeable Difference Estimation of Natural Imagescited by 15
  12. 2025SQAP-VLA: A Synergistic Quantization-Aware Pruning Framework for High-Performance Vision-Language-Action Modelscited by 15
  13. 2024Feature Coding in the Era of Large Models: Dataset, Test Conditions, and Benchmarkcited by 12
  14. 2025Just Noticeable Difference for Large Multimodal Modelscited by 9
  15. 2022Perceptual Video Coding for Machines via Satisfied Machine Ratio Modelingcited by 7
  16. 2024DMOFC: Discrimination Metric-Optimized Feature Compressioncited by 7
  17. 2025DT-UFC: Universal Large Model Feature Coding via Peaky-to-Balanced Distribution Transformationcited by 6
  18. 2025Image Quality Assessment for Embodied AIcited by 4
  19. 2025Compressed Feature Quality Assessment: Dataset and Baselinescited by 3
  20. 2026Just Noticeable Difference Modeling for Deep Visual Featurescited by 3
  21. 2023Localization of Just Noticeable Difference for Image Compressioncited by 2
  22. 2025Embodied Image Compressioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Compression Gap: Why Discrete Tokenization Limits Vision-Language-Action Model Scaling
  2. 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models
  3. 2026Beyond Attention Magnitude: Leveraging Inter-layer Rank Consistency for Efficient Vision-Language-Action Models
  4. 2026DTP: A Simple yet Effective Distracting Token Pruning Framework for Vision-Language Action Models
  5. 2025Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Models
  6. 2026QVLA: Not All Channels Are Equal in Vision-Language-Action Model's Quantization
  7. 2026Ordered Action Tokens for Visuomotor Policy Learning
  8. 2026ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models