mlsanityData to 14 Oct 2026

PRTS: A Primitive Reasoning and Tasking System via Contrastive Representations

arXiv 2604.27472 ↗First posted 30 Apr 2026cs.AI cs.LG cs.ROcited by 9

On the map: Vision-language-action models → Reinforcement learning and post-training

Abstract (arXiv)

Vision-Language-Action (VLA) models advance robotic control via strong visual-linguistic priors. However, existing VLAs predominantly frame pretraining as supervised behavior cloning, overlooking the fundamental nature of robot learning as a goal-reaching process that requires understanding temporal task progress. We present PRTS (Primitive Reasoning and Tasking System), a VLA foundation model that reformulates pretraining through Goal-Conditioned Reinforcement Learning. By treating language instructions as goals and employing contrastive reinforcement learning, PRTS learns a unified embedding space where the inner product of state-action and goal embeddings approximates the log-discounted goal occupancy, the probability of reaching the language-specified goal from the current state-action, quantitatively assessing physical feasibility beyond static semantic matching. PRTS draws this dense goal-reachability supervision directly from offline trajectories without reward annotations, and folds it into the VLM backbone via a role-aware causal mask, incurring negligible overhead over vanilla behavior cloning. This paradigm endows the high-level reasoning system with intrinsic goal reachability awareness, bridging semantic reasoning and temporal task progress, and further benefits goal-conditioned action prediction. Pretrained on 167B tokens of diverse manipulation and embodied-reasoning data, PRTS reaches state-of-the-art performance on LIBERO, LIBERO-Pro, LIBERO-Plus, SimplerEnv, and a real-world suite of 14 complex tasks, with particularly substantial gains on long-horizon, contact-rich, and zero-shot novel-instruction settings, confirming that injecting goal-reachability awareness significantly improves both execution success and long-horizon planning of general-purpose robotic foundation policies.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 39 of its 73 references that are in the map. First posted on arXiv 30 Apr 2026.

Builds on

39 of 73 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025π*0.6: a VLA That Learns From Experience18 Nov
  2. 2025A Vision-Language-Action-Critic Model for Robotic Real-World Reinforcement Learning19 Sep
  3. 2025Align-Then-stEer: Adapting the Vision-Language Action Models through Unified Latent Guidance2 Sep
  4. 2025Interactive Post-Training for Vision-Language-Action Models22 May

Other references · 35

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2025Qwen3-VL Technical Reportcited by 2,793
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  4. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  6. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  7. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  8. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  9. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  10. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  11. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
  12. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
23 more
  1. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
  2. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  3. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
  4. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
  5. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
  6. 2024Flow Matching Guide and Codecited by 301
  7. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
  8. 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 179
  9. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 175
  10. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
  11. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
  12. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 127
  13. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 127
  14. 2026A Pragmatic VLA Foundation Modelcited by 103
  15. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
  16. 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policiescited by 90
  17. 2024What Matters in Building Vision-Language-Action Models for Generalist Robotscited by 89
  18. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 86
  19. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 84
  20. 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planningcited by 69
  21. 2026FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scalingcited by 66
  22. 2025Igniting VLMs toward the Embodied Spacecited by 53
  23. 2025Steering Vision-Language-Action Models as Anti-Exploration: A Test-Time Scaling Approachcited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025GoalLadder: Incremental Goal Discovery with Vision-Language Models
  2. 2026Explicit Language Memory for Long-Horizon Planning in Vision-Language-Action Models
  3. 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts
  4. 2025Can Pretrained Vision-Language Embeddings Alone Guide Robot Navigation?
  5. 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification
  6. 2026Vision-Language-Action Jump-Starting for Reinforcement Learning Robotic Agents
  7. 2026Reasoning Without Inference Cost: Latent Semantic Scaffolding for Robot VLA Policies
  8. 2026Steerable Vision-Language-Action Policies for Embodied Reasoning and Hierarchical Control