mlsanityData to 7 Oct 2026

Real2Sim2Real for Vision-Language-Action Manipulation: An AMD ROCm-Based Pipeline

arXiv 2607.22997 ↗First posted 25 Jul 2026cs.RO cs.AI cs.GRcited by 0

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Physical AI -- the integration of large vision-language-action (VLA) models with embodied agents that act in the real world -- has emerged as the next major frontier for AI, echoed by industry leaders such as Jensen Huang (``the next big thing is Physical AI, AI with a body,'' GTC Paris, June 2025) and Dr. Lisa Su (`we're entering the world of Physical AI ... this is where AI enters the real world,' CES 2026). This paper presents an end-to-end, fully AMD-accelerated technology stack for embodied manipulation, spanning data-center training silicon, Radeon PRO simulation/rendering GPUs, and Ryzen AI edge compute, unified by the open ROCm software stack. We demonstrate that training and deploying VLA-based manipulation policies does not require a CUDA-locked ecosystem. Four progressive demonstrations are presented: (1) a Sim-to-Real manipulation pipeline trained with SmolVLA and deployed on a physical Franka arm; (2) a semantic, language-grounded object-selection task (`one-of-three'); (3) a Real2Sim synthetic-data generation pipeline that fuses 3D Gaussian Splatting (3DGS) reconstructions of real scenes with the Genesis physics engine; and (4) large-scale reinforcement learning for quadruped and humanoid locomotion benchmarked across multiple hardware platforms. All pipelines run natively on ROCm + PyTorch on RDNA4 (Radeon AI PRO R9700) and RDNA3.5 (Radeon PRO W7900) hardware and are reproducible on the free Radeon Cloud Platform.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 1 of its 10 references that are in the map. First posted on arXiv 25 Jul 2026.

Builds on

1 of 10 references.

References · 1

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DM0: An Embodied-Native Vision-Language-Action Model towards Physical AI
  2. 2026Agentic Real2Sim: Physics-based World Modeling with Vision-Language Agents
  3. 2026PhysVLA: Towards Physically-Grounded VLA for Embodied Robotic Manipulation
  4. 2025Survey of Vision-Language-Action Models for Embodied Manipulation
  5. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey
  6. 2026SimVLA: A Simple VLA Baseline for Robotic Manipulation
  7. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
  8. 2025Towards Accessible Physical AI: LoRA-Based Fine-Tuning of VLA Models for Real-World Robot Control