mlsanityData to 7 Oct 2026

OpenSPM: An Environment-Transferable Robotic Key Spatial Pose Memory and Closed-Loop High-Frequency Flow-Matching Action Generation Model

arXiv 2606.29936 ↗First posted 29 Jun 2026cs.ROcited by 0

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

Open-environment tabletop robotic manipulation requires systems to possess semantic understanding, precise geometric pose estimation, and high-frequency action generation. While end-to-end vision-language-action (VLA) models excel at semantic generalization, they often lack explicit geometric constraints for fine-grained tasks and require costly training. To bridge the gap between high-level semantics and low-level physical execution, we propose OpenSPM, an open environment spatial persistent memory framework consisting of spatial pose memory and flow-matching action generation model. OpenSPM first leverages semantically conditioned 3D perception and Kalman filtering to track continuous 6D poses. It then extracts key spatial poses from human demonstrations, keeping them as transferable, object-centric spatial persistent memory entries. During inference, OpenSPM retrieves relevant memory entries in terms of natural language instructions, transfers the spatial poses to new scenes using SE(3) transformations, and generates high-frequency action chunks via a lightweight conditional flow-matching model. Combined with real-time proprioceptive state feedback and terminal residual correction, the system effectively suppresses trajectory error accumulation. Evaluated on ten LIBERO-GOAL tasks, OpenSPM achieves an 85.6% success rate and an equivalent control frequency of 1033.3 Hz, while requiring minimal inference AI computing power. Extensive ablations illustrate that structured spatial persistent memory and closed-loop residual correction play a crucial role in reliable, high-frequency robotic manipulation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 25 of its 27 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

25 of 27 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar

Other references · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2023Segment Anythingcited by 8,158
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2022Flow Matching for Generative Modelingcited by 5,426
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  8. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  9. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  10. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  11. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  12. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
12 more
  1. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  2. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  3. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  4. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
  5. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
  6. 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 678
  7. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  8. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  9. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  10. 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 342
  11. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
  12. 2025SAM 3D: 3Dfy Anything in Imagescited by 230

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024DynaMem: Online Dynamic Spatio-Semantic Memory for Open World Mobile Manipulation
  2. 2026RoboStream: Weaving Spatio-Temporal Reasoning with Memory in Vision-Language Models for Robotics
  3. 2026Dynamic Resilient Spatio-Semantic Memory with Hybrid Localization for Mobile Manipulation ↗
  4. 2026Mem-World: Memory-Augmented Action-Conditioned World Models for Persistent Robot Manipulation
  5. 2026Closing the Loop in Humanoid VLA: Persistent 3D Object Tokens for Verifiable Loco-Manipulation
  6. 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory
  7. 2025IGen: Scalable Data Generation for Robot Learning from Open-World Images
  8. 2026SAVLA: Symmetry-Aware Vision-Language-Action Models for Robotic Manipulation