OASIS: Observation-Action Space Alignment via SE(3) Trajectory Prediction for Robotic Manipulation
On the map: World models → Embodied and robot world models
also in 1 more
Abstract (arXiv)
Recent vision-language-action (VLA) models and world action models (WAMs) advance robotic manipulation by enriching intermediate representations with auxiliary spatial features or future visual-state prediction. However, these representations largely remain within the observation space and do not share the rigid-body geometry of the action space, forcing the action decoder to implicitly recover this geometry. We propose OASIS, a visuomotor policy that aligns the intermediate representation with the action space via SE(3) end-effector trajectory prediction. OASIS couples a 3D-aware feature encoder that fuses vision-language and metric-depth features with an SE(3) trajectory predictor that produces a camera-frame end-effector trajectory. Conditioned on the predictor's pose-supervised hidden states, the action decoder generates action chunks consistent with rigid-body motion. Across simulation and real-world experiments, OASIS outperforms VLA and WAM baselines in success rate and out-of-distribution generalization. Our project page is available at https://npuhandsome.github.io/OASISweb.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 64 of its 65 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
64 of 65 references.
Closest ancestors · 7
Same direction, newest first
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
- 2024PIVOT-R: Primitive-Driven Waypoint-Aware World Model for Robotic Manipulation14 Oct
- 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models16 Oct
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
Other references · 57
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023Visual Instruction Tuningcited by 7,792
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
38 more
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2024Depth Anything V2cited by 1,385
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 278
- 2023Any-point Trajectory Modeling for Policy Learningcited by 207
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
- 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 144
- 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 135
- 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 135
- 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 131
- 2025Unified Vision-Language-Action Modelcited by 128
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 116
- 2025PointVLA: Injecting the 3D World into Vision-Language-Action Modelscited by 101
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
- 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
- 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Modelscited by 77
- 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulationcited by 71
- 2024Efficient Diffusion Transformer Policies with Mixture of Expert Denoisers for Multitask Learningcited by 46
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulationcited by 0
- 2026FAN: Foresight Action Normalization for Continual Adaptation of Vision-Language-Action Modelscited by 0
- 2026World Motion Models: Flexible Sequence Modeling of SE(3) Trajectoriescited by 0
- 2026World Motion Models: Flexible Sequence Modeling of SE(3) Trajectories1 Oct 2026
- 2026FAN: Foresight Action Normalization for Continual Adaptation of Vision-Language-Action Models18 Sep 2026
- 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulation26 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policy
- 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Models
- 2026JoyAI-RA 0.5: Scaling Robot Manipulation Learning via Dual Action Alignment
- 2026Robotic Manipulation is Vision-to-Geometry Mapping: Vision-Geometry Backbones over Language and Video Models
- 2026FRAM: Trajectory-Guided Visual Feature Selection for Compact Language-Conditioned Robot Manipulation
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection
- 2026DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulation
- 2026GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation