PRTS: A Primitive Reasoning and Tasking System via Contrastive Representations
On the map: Vision-language-action models → Reinforcement learning and post-training
Abstract (arXiv)
Vision-Language-Action (VLA) models advance robotic control via strong visual-linguistic priors. However, existing VLAs predominantly frame pretraining as supervised behavior cloning, overlooking the fundamental nature of robot learning as a goal-reaching process that requires understanding temporal task progress. We present PRTS (Primitive Reasoning and Tasking System), a VLA foundation model that reformulates pretraining through Goal-Conditioned Reinforcement Learning. By treating language instructions as goals and employing contrastive reinforcement learning, PRTS learns a unified embedding space where the inner product of state-action and goal embeddings approximates the log-discounted goal occupancy, the probability of reaching the language-specified goal from the current state-action, quantitatively assessing physical feasibility beyond static semantic matching. PRTS draws this dense goal-reachability supervision directly from offline trajectories without reward annotations, and folds it into the VLM backbone via a role-aware causal mask, incurring negligible overhead over vanilla behavior cloning. This paradigm endows the high-level reasoning system with intrinsic goal reachability awareness, bridging semantic reasoning and temporal task progress, and further benefits goal-conditioned action prediction. Pretrained on 167B tokens of diverse manipulation and embodied-reasoning data, PRTS reaches state-of-the-art performance on LIBERO, LIBERO-Pro, LIBERO-Plus, SimplerEnv, and a real-world suite of 14 complex tasks, with particularly substantial gains on long-horizon, contact-rich, and zero-shot novel-instruction settings, confirming that injecting goal-reachability awareness significantly improves both execution success and long-horizon planning of general-purpose robotic foundation policies.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 39 of its 73 references that are in the map. First posted on arXiv 30 Apr 2026.
Builds on
39 of 73 references.
Closest ancestors · 4
Same direction, newest first
- 2025π*0.6: a VLA That Learns From Experience18 Nov
- 2025A Vision-Language-Action-Critic Model for Robotic Real-World Reinforcement Learning19 Sep
- 2025Align-Then-stEer: Adapting the Vision-Language Action Models through Unified Latent Guidance2 Sep
- 2025Interactive Post-Training for Vision-Language-Action Models22 May
Other references · 35
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
23 more
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
- 2024Flow Matching Guide and Codecited by 301
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 179
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 175
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
- 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 127
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 127
- 2026A Pragmatic VLA Foundation Modelcited by 103
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
- 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policiescited by 90
- 2024What Matters in Building Vision-Language-Action Models for Generalist Robotscited by 89
- 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 86
- 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 84
- 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planningcited by 69
- 2026FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scalingcited by 66
- 2025Igniting VLMs toward the Embodied Spacecited by 53
- 2025Steering Vision-Language-Action Models as Anti-Exploration: A Test-Time Scaling Approachcited by 21
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026SafeVLA-Bench: A Benchmark for the Success-Safety Gap in Vision-Language-Action Modelscited by 9
- 2026VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Trainingcited by 2
- 2026Long-WAM: Scaling the Context of World-Action Modelscited by 1
- 2026LM-X: Explainable Vision--Language--Action Modeling via Progress, Event, and Uncertainty Predictioncited by 0
- 2026V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latentscited by 0
- 2026World Action Modeling with Progressive Visual Planningcited by 0
- 2026SMART: Zero-Shot Sim-to-Real Articulated Object Manipulation via Large-Scale Synthetic Pretrainingcited by 0
- 2026RoboAware: Learning to Coordinate Embodied Skills from Counterfactual Outcomescited by 0
- 2026LoopWAM: Closed-Loop Generalist Policy Improvement from Deployment Rolloutscited by 0
- 2026LoopWAM: Closed-Loop Generalist Policy Improvement from Deployment Rollouts13 Oct 2026
- 2026RoboAware: Learning to Coordinate Embodied Skills from Counterfactual Outcomes8 Oct 2026
- 2026Long-WAM: Scaling the Context of World-Action Models7 Oct 2026
- 2026SMART: Zero-Shot Sim-to-Real Articulated Object Manipulation via Large-Scale Synthetic Pretraining6 Oct 2026
- 2026World Action Modeling with Progressive Visual Planning1 Oct 2026
- 2026V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latents29 Sep 2026
- 2026LM-X: Explainable Vision--Language--Action Modeling via Progress, Event, and Uncertainty Prediction26 Aug 2026
- 2026VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Training3 Jun 2026
- 2026SafeVLA-Bench: A Benchmark for the Success-Safety Gap in Vision-Language-Action Models30 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025GoalLadder: Incremental Goal Discovery with Vision-Language Models
- 2026Explicit Language Memory for Long-Horizon Planning in Vision-Language-Action Models
- 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts
- 2025Can Pretrained Vision-Language Embeddings Alone Guide Robot Navigation?
- 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification
- 2026Vision-Language-Action Jump-Starting for Reinforcement Learning Robotic Agents
- 2026Reasoning Without Inference Cost: Latent Semantic Scaffolding for Robot VLA Policies
- 2026Steerable Vision-Language-Action Policies for Embodied Reasoning and Hierarchical Control