mlsanityData to 7 Oct 2026

Direction-Scale Decomposition in Action Representation: Rethinking What to Tokenize for Vision-Language-Action Models

arXiv 2609.28865 ↗First posted 24 Sep 2026cs.CV cs.ROcited by 0

On the map: Vision-language-action models → Human-video and latent-action pretraining also fits: 3D and spatial-aware VLA

Abstract (arXiv)

Action representation plays a central role in discrete-token vision-language-action (VLA) learning but remains underexamined. Under conventional pose-increment representations, action tokens are sensitive to execution speed and dataset-specific normalization, potentially obscuring geometric structure shared across demonstrations and datasets. We introduce Direction-Scale Decomposition (DSD), an action representation that decomposes translation and rotation increments into direction and scale components before tokenization. DSD isolates motion direction while retaining magnitudes in separate scale channels. We evaluate DSD with uniform binning (BIN) and BEAST, a B-spline-based tokenizer, in simulation and real-world manipulation under both single-dataset and mixed-dataset training. On LIBERO, DSD improves average success rates with both tokenizers. On SimplerEnv, DSD-BIN outperforms BIN by 10.3 percentage points in overall success rate under mixed-dataset training. Real-robot experiments further show gains both with and without robotics pretraining. These results support DSD as an effective action representation for discrete-token VLA models and suggest its potential to mitigate performance degradation when training on large and diverse dataset mixtures. Our project page with additional resources is available at https://vla-dsd.github.io/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 16 of its 19 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

16 of 19 references.

References · 16

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  3. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  6. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  7. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  8. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  9. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  10. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
  11. 2024Behavior Generation with Latent Actionscited by 159
  12. 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policiescited by 90
4 more
  1. 2024Keypoint Action Tokens Enable In-Context Imitation Learning in Roboticscited by 71
  2. 2025BEAST: Efficient Tokenization of B-Splines Encoded Action Sequences for Imitation Learningcited by 25
  3. 2026ActionCodec: What Makes for Good Action Tokenizerscited by 17
  4. 2026MoMo: Dial Motion Mode in Robot Manipulation with Spatiotemporal Action Tokenizationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Lost in Reconstruction: Aligning Action Representations with Language in Vision-Language-Action Models
  2. 2026ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models
  3. 2026Beyond World-Frame Action Heads: Motion-Centric Action Frames for Vision-Language-Action Models
  4. 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
  5. 2026LAST: Bridging Vision-Language and Action Manifolds via Gromov-Wasserstein Alignment
  6. 2026V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models
  7. 2026Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment
  8. 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models