mlsanityData to 7 Oct 2026

OASIS: Observation-Action Space Alignment via SE(3) Trajectory Prediction for Robotic Manipulation

arXiv 2605.25829 ↗First posted 25 May 2026cs.RO cs.AIcited by 3

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

Recent vision-language-action (VLA) models and world action models (WAMs) advance robotic manipulation by enriching intermediate representations with auxiliary spatial features or future visual-state prediction. However, these representations largely remain within the observation space and do not share the rigid-body geometry of the action space, forcing the action decoder to implicitly recover this geometry. We propose OASIS, a visuomotor policy that aligns the intermediate representation with the action space via SE(3) end-effector trajectory prediction. OASIS couples a 3D-aware feature encoder that fuses vision-language and metric-depth features with an SE(3) trajectory predictor that produces a camera-frame end-effector trajectory. Conditioned on the predictor's pose-supervised hidden states, the action decoder generates action chunks consistent with rigid-body motion. Across simulation and real-world experiments, OASIS outperforms VLA and WAM baselines in success rate and out-of-distribution generalization. Our project page is available at https://npuhandsome.github.io/OASISweb.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 64 of its 65 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

64 of 65 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  2. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
  3. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
  4. 2024PIVOT-R: Primitive-Driven Waypoint-Aware World Model for Robotic Manipulation14 Oct
  5. 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar
  6. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models16 Oct
  7. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar

Other references · 57

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  7. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  8. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  9. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  10. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  11. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  12. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
38 more
  1. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  2. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  3. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  4. 2024Depth Anything V2cited by 1,385
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  6. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  7. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  8. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  9. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  10. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  11. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  12. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  13. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  14. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  15. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  16. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  17. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
  18. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
  19. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
  20. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  21. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
  22. 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 278
  23. 2023Any-point Trajectory Modeling for Policy Learningcited by 207
  24. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
  25. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
  26. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
  27. 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 144
  28. 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 135
  29. 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 135
  30. 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 131
  31. 2025Unified Vision-Language-Action Modelcited by 128
  32. 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 116
  33. 2025PointVLA: Injecting the 3D World into Vision-Language-Action Modelscited by 101
  34. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
  35. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
  36. 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Modelscited by 77
  37. 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulationcited by 71
  38. 2024Efficient Diffusion Transformer Policies with Mixture of Expert Denoisers for Multitask Learningcited by 46

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policy
  2. 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Models
  3. 2026JoyAI-RA 0.5: Scaling Robot Manipulation Learning via Dual Action Alignment
  4. 2026Robotic Manipulation is Vision-to-Geometry Mapping: Vision-Geometry Backbones over Language and Video Models
  5. 2026FRAM: Trajectory-Guided Visual Feature Selection for Compact Language-Conditioned Robot Manipulation
  6. 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection
  7. 2026DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulation
  8. 2026GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation