RLDX-1 Technical Report
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
While Vision-Language-Action models (VLAs) have shown remarkable progress toward human-like generalist robotic policies through the versatile intelligence (i.e. broad scene understanding and language-conditioned generalization) inherited from pre-trained Vision-Language Models, they still struggle with complex real-world tasks requiring broader functional capabilities (e.g. motion awareness, long-term memory, and physical sensing). To address this, we introduce RLDX-1, a general-purpose robotic policy for dexterous manipulation built on the Multi-Stream Action Transformer (MSAT), an architecture that unifies these capabilities by integrating heterogeneous modalities through modality-specific streams with cross-modal joint self-attention. RLDX-1 further combines this architecture with system-level design choices, including data synthesis for rare manipulation scenarios, learning procedures specialized for human-like manipulation, and inference optimizations for real-time deployment. Through empirical evaluation, we show that RLDX-1 consistently outperforms recent frontier VLAs (e.g. π0.5 and GR00T N1.6) across both simulation benchmarks and real-world tasks that require broad functional capabilities beyond general versatility. In particular, RLDX-1 shows superiority in ALLEX humanoid tasks by achieving success rates of 86.8% while π0.5 and GR00T N1.6 achieve around 40%, highlighting the ability of RLDX-1 to control a high-DoF humanoid robot under diverse functional demands. Together, these results position RLDX-1 as a promising step toward reliable VLAs for complex, contact-rich, and dynamic real-world dexterous manipulation.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 55 of its 125 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
55 of 125 references.
Closest ancestors · 10
Same direction, newest first
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AI25 Nov
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model11 Oct
- 2025ContextVLA: Vision-Language-Action Model with Amortized Multi-Frame Context5 Oct
- 2025Galaxea Open-World Dataset and G0 Dual-System VLA Model30 Aug
- 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Models31 Jul
- 2025Unified Vision-Language-Action Model24 Jun
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
- 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extraction5 Mar
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation29 Nov
Other references · 45
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2025Gemma 3 Technical Reportcited by 1,824
- 2020GLU Variants Improve Transformercited by 1,804
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
33 more
- 2026World Action Models are Zero-shot Policiescited by 465
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
- 2025π*0.6: a VLA That Learns From Experiencecited by 303
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
- 2025Transfer between Modalities with MetaQueriescited by 236
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 138
- 2025ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulationcited by 91
- 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 83
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 79
- 2025MemER: Scaling Up Memory for Robot Control via Experience Retrievalcited by 67
- 2025Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Modelscited by 64
- 2025SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulationcited by 61
- 2026Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisonscited by 60
- 2025VTLA: Vision-Tactile-Language-Action Model with Preference Learning for Insertion Manipulationcited by 55
- 2025Robo-Dopamine: General Process Reward Modeling for High-Precision Robotic Manipulationcited by 40
- 2025VLA-Touch: Enhancing Vision-Language-Action Models with Dual-Level Tactile Feedbackcited by 38
- 2025OmniVTLA: Vision-Tactile-Language-Action Models with Semantic-Aligned Tactile Sensingcited by 38
- 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Modelcited by 36
- 2025TA-VLA: Elucidating the Design Space of Torque-aware Vision-Language-Action Modelscited by 32
- 2025Learning Long-Context Diffusion Policies via Past-Token Predictioncited by 30
- 2021Keyframe-Focused Visual Imitation Learningcited by 25
- 2025Humanoid Everyday: A Comprehensive Robotic Dataset for Open-World Humanoid Manipulationcited by 25
- 2025Vlaser: Vision-Language-Action Model with Synergistic Embodied Reasoningcited by 23
- 2026Interpreting Physics in Video World Modelscited by 22
- 2025Tactile-VLA: Unlocking Vision-Language-Action Model's Physical Knowledge for Tactile Generalizationcited by 19
- 2026RoboCurate: Harnessing Diversity with Action-Verified Neural Trajectory for Robot Learningcited by 8
- 2026RoboAlign: Learning Test-Time Reasoning for Language-Action Alignment in Vision-Language-Action Modelscited by 3
- 2026Modular Sensory Stream for Integrating Physical Feedback in Vision-Language-Action Modelscited by 3
- 2026SpatialBoost: Enhancing Visual Representation through Language-Guided Reasoningcited by 2
- 2026Exploring High-Order Self-Similarity for Video Understandingcited by 1
Built on by
Citing papers per year: 2026: 28.
28 papers.
Sort:
By area:
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 50
- 2026Harness VLA: Steering Frozen VLAs into Reliable Manipulation Primitives via Memory-Guided Agentscited by 47
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Modelcited by 30
- 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectoriescited by 29
- 2026From Foundation to Application: Improving VLA Models in Practicecited by 26
- 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibilitycited by 11
- 2026SafeVLA-Bench: A Benchmark for the Success-Safety Gap in Vision-Language-Action Modelscited by 9
- 2026PhyAgentOS: A Self-Evolving Operating System for Embodied Agents with Decoupled Cognitive Planning and Physical Executioncited by 6
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-trainingcited by 4
- 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulationcited by 4
- 2026Fewer Tokens, Better Action: GPT-6 Astra Robot Agents with 14% Higher Success Rate but 65% Fewer Tokenscited by 4
- 2026Latent Action as Intention Enables Efficient Future Imagination for World Action Modelscited by 3
16 more
- 2026EmbodiedRSI: Active Continual Robot Learning Through Hypothesis-Guided Co-Evolutioncited by 2
- 2026Pose6DAug: Physically Plausible Multi-view Object Swapping for Robot Data Augmentationcited by 1
- 2026Long-WAM: Scaling the Context of World-Action Modelscited by 1
- 2026Embodied Turing Machines: Stateful Code for Robot Recursive Self-Improvementcited by 1
- 2026RobotValues: Evaluating Household Robots When Human Values Conflictcited by 0
- 2026ZeroDex: Zero-Shot Long-Horizon Dexterous Manipulation via Multi-View 3D-Grounded VLM Reasoningcited by 0
- 2026WorldToken: Time-First Sequence Modeling for Robotic Imitation Learningcited by 0
- 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Modelscited by 0
- 2026Beyond Future Prediction: Denoising as Generative Adaptation for Robot Controlcited by 0
- 2026Dynamic Manipulation with World-Action Models via Counterfactual Planningcited by 0
- 2026Spotter: Let the Embodied Model Lead, and the VLM Reflect for Itcited by 0
- 2026DriftOPD: Sequence-Level Reverse-KL Distillation for One-Step VLA Policiescited by 0
- 2026World Action Modeling with Progressive Visual Planningcited by 0
- 2026RLHND: Video Foundation Models as Physically Grounded Hand Trackers for Robot Learningcited by 0
- 2026Q-Learning with Scalar Adjoint Matchingcited by 0
- 2026LoopWAM: Closed-Loop Generalist Policy Improvement from Deployment Rolloutscited by 0
- 2026LoopWAM: Closed-Loop Generalist Policy Improvement from Deployment Rollouts13 Oct 2026
- 2026Embodied Turing Machines: Stateful Code for Robot Recursive Self-Improvement8 Oct 2026
- 2026Long-WAM: Scaling the Context of World-Action Models7 Oct 2026
- 2026EmbodiedRSI: Active Continual Robot Learning Through Hypothesis-Guided Co-Evolution7 Oct 2026
- 2026Q-Learning with Scalar Adjoint Matching7 Oct 2026
- 2026RLHND: Video Foundation Models as Physically Grounded Hand Trackers for Robot Learning7 Oct 2026
- 2026World Action Modeling with Progressive Visual Planning1 Oct 2026
- 2026Fewer Tokens, Better Action: GPT-6 Astra Robot Agents with 14% Higher Success Rate but 65% Fewer Tokens1 Oct 2026
- 2026DriftOPD: Sequence-Level Reverse-KL Distillation for One-Step VLA Policies29 Sep 2026
- 2026Spotter: Let the Embodied Model Lead, and the VLM Reflect for It29 Sep 2026
- 2026Dynamic Manipulation with World-Action Models via Counterfactual Planning27 Sep 2026
- 2026Beyond Future Prediction: Denoising as Generative Adaptation for Robot Control23 Sep 2026
16 more
- 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulation3 Sep 2026
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training31 Aug 2026
- 2026Latent Action as Intention Enables Efficient Future Imagination for World Action Models25 Aug 2026
- 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Models24 Aug 2026
- 2026WorldToken: Time-First Sequence Modeling for Robotic Imitation Learning23 Aug 2026
- 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibility11 Aug 2026
- 2026PhyAgentOS: A Self-Evolving Operating System for Embodied Agents with Decoupled Cognitive Planning and Physical Execution18 Jul 2026
- 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectories16 Jul 2026
- 2026Harness VLA: Steering Frozen VLAs into Reliable Manipulation Primitives via Memory-Guided Agents9 Jul 2026
- 2026From Foundation to Application: Improving VLA Models in Practice7 Jul 2026
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Model1 Jul 2026
- 2026Pose6DAug: Physically Plausible Multi-view Object Swapping for Robot Data Augmentation18 Jun 2026
- 2026ZeroDex: Zero-Shot Long-Horizon Dexterous Manipulation via Multi-View 3D-Grounded VLM Reasoning17 Jun 2026
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Models16 Jun 2026
- 2026RobotValues: Evaluating Household Robots When Human Values Conflict2 Jun 2026
- 2026SafeVLA-Bench: A Benchmark for the Success-Safety Gap in Vision-Language-Action Models30 May 2026
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Modelcited by 30
- 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibilitycited by 11
- 2026PhyAgentOS: A Self-Evolving Operating System for Embodied Agents with Decoupled Cognitive Planning and Physical Executioncited by 6
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-trainingcited by 4
- 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulationcited by 4
- 2026Latent Action as Intention Enables Efficient Future Imagination for World Action Modelscited by 3
- 2026Long-WAM: Scaling the Context of World-Action Modelscited by 1
- 2026Dynamic Manipulation with World-Action Models via Counterfactual Planningcited by 0
- 2026World Action Modeling with Progressive Visual Planningcited by 0
- 2026LoopWAM: Closed-Loop Generalist Policy Improvement from Deployment Rolloutscited by 0
- 2026LoopWAM: Closed-Loop Generalist Policy Improvement from Deployment Rollouts13 Oct 2026
- 2026Long-WAM: Scaling the Context of World-Action Models7 Oct 2026
- 2026World Action Modeling with Progressive Visual Planning1 Oct 2026
- 2026Dynamic Manipulation with World-Action Models via Counterfactual Planning27 Sep 2026
- 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulation3 Sep 2026
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training31 Aug 2026
- 2026Latent Action as Intention Enables Efficient Future Imagination for World Action Models25 Aug 2026
- 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibility11 Aug 2026
- 2026PhyAgentOS: A Self-Evolving Operating System for Embodied Agents with Decoupled Cognitive Planning and Physical Execution18 Jul 2026
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Model1 Jul 2026
- 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectoriescited by 29
- 2026From Foundation to Application: Improving VLA Models in Practicecited by 26
- 2026SafeVLA-Bench: A Benchmark for the Success-Safety Gap in Vision-Language-Action Modelscited by 9
- 2026Pose6DAug: Physically Plausible Multi-view Object Swapping for Robot Data Augmentationcited by 1
- 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Modelscited by 0
- 2026DriftOPD: Sequence-Level Reverse-KL Distillation for One-Step VLA Policiescited by 0
- 2026DriftOPD: Sequence-Level Reverse-KL Distillation for One-Step VLA Policies29 Sep 2026
- 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Models24 Aug 2026
- 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectories16 Jul 2026
- 2026From Foundation to Application: Improving VLA Models in Practice7 Jul 2026
- 2026Pose6DAug: Physically Plausible Multi-view Object Swapping for Robot Data Augmentation18 Jun 2026
- 2026SafeVLA-Bench: A Benchmark for the Success-Safety Gap in Vision-Language-Action Models30 May 2026
- 2026Q-Learning with Scalar Adjoint Matchingcited by 0
- 2026Q-Learning with Scalar Adjoint Matching7 Oct 2026
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 50
- 2026EmbodiedRSI: Active Continual Robot Learning Through Hypothesis-Guided Co-Evolutioncited by 2
- 2026RobotValues: Evaluating Household Robots When Human Values Conflictcited by 0
- 2026Spotter: Let the Embodied Model Lead, and the VLM Reflect for Itcited by 0
- 2026RLHND: Video Foundation Models as Physically Grounded Hand Trackers for Robot Learningcited by 0
- 2026EmbodiedRSI: Active Continual Robot Learning Through Hypothesis-Guided Co-Evolution7 Oct 2026
- 2026RLHND: Video Foundation Models as Physically Grounded Hand Trackers for Robot Learning7 Oct 2026
- 2026Spotter: Let the Embodied Model Lead, and the VLM Reflect for It29 Sep 2026
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Models16 Jun 2026
- 2026RobotValues: Evaluating Household Robots When Human Values Conflict2 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025GR-Dexter Technical Report
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
- 2025REALM: A Real-to-Sim Validated Benchmark for Generalization in Robotic Manipulation
- 2026Colosseum V2: Benchmarking Generalization for Vision-Language-Action Models
- 2026Scaling World Model for Hierarchical Manipulation Policies
- 2026RDT2: Exploring the Scaling Limit of UMI Data Towards Zero-Shot Cross-Embodiment Generalization
- 2025GR-RL: Going Dexterous and Precise for Long-Horizon Robotic Manipulation
- 2026Vision-Language-Action Models: Experimental Insights from a Real-World UR5 Platform