Sigma: The Key for Vision-Language-Action Models toward Telepathic Alignment
On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA
Abstract (arXiv)
To address a fundamental limitation in cognitive systems, namely the absence of a time-updatable mediating thought space between semantics and continuous control, this work constructs and trains a vision-language-action model termed Sigma, deployed on a single RTX 4090. The model is built upon the open-source pi0.5_base backbone, with the svla_so101_pickplace dataset preprocessed into a structured training corpus. An independently designed VLA architecture is introduced to integrate deep semantic understanding with associative reasoning, enabling telepathic-style alignment between perception and action. Training proceeds through iterative optimization of data preprocessing, LoRA-based fine-tuning, and inference-stage adapter design. Evaluation is conducted using offline closed-loop replay, comparing Sigma against the untuned pi0.5_base under identical data conditions. Experimental results indicate a consistent reduction in control MSE across vector-, fragment-, and trajectory-level scales, while preserving the stability of the telepathy norm and semantic-text alignment quality. These findings demonstrate that mind-responsive alignment control can be quantitatively achieved through semantic and associative architectural integration without retraining the base model, providing a reproducible pathway for semantic alignment and intention-driven behavior.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 25 of its 29 references that are in the map. First posted on arXiv 30 Nov 2025.
Builds on
25 of 29 references.
Closest ancestors · 2
Same direction, newest first
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Model20 Feb
Other references · 23
- 2017Attention Is All You Needcited by 60,361
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2022Multimodal Learning with Transformers: A Surveycited by 400
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 255
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
- 2021On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptationcited by 147
- 2023Meta-Transformer: A Unified Framework for Multimodal Learningcited by 136
11 more
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 84
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 74
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
- 2025LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instructioncited by 43
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Reviewcited by 38
- 2025CO-RFT: Efficient Fine-Tuning of Vision-Language-Action Models through Chunked Offline Reinforcement Learningcited by 37
- 2025Towards a Unified Understanding of Robot Manipulation: A Comprehensive Surveycited by 32
- 2025Thought Communication in Multiagent Collaborationcited by 30
- 2023A Theory of Multimodal Learningcited by 25
- 2024Transformer-Based Models Are Not Yet Perfect At Learning to Emulate Structural Recursioncited by 14
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification
- 2025Token-Level Inference-Time Alignment for Vision-Language Models
- 2026Continuous Reasoning for Vision-Language-Action
- 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Models
- 2025DeepThinkVLA: Enhancing Reasoning Capability of Vision-Language-Action Models
- 2026UAM: A Dual-Stream Perspective on Forgetting in VLA Training
- 2026Reasoning as a Double-Edged Sword: Architecture and Cross-Stage Robustness in Vision-Language-Action Models
- 2026Alignment among Language, Vision and Action Representations