OCC4M: Object-Centric 4D Memory for Spatiotemporal Reasoning in Long-Horizon Manipulation
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Long-horizon manipulation often requires reasoning about state absent from the current view, such as a vanished object's location, temporal identity, or the contents of a shuffled container. We present OCC4M ("Occam"), an object-centric 4D memory that maintains persistent tracks in a shared world frame and explicitly represents temporal, motion, and containment relations. A vision-language model (VLM) queries this structured memory to select actionable targets for history-free low-level execution. Across seven simulation conditions and 350 episodes, OCC4M achieves 96.6% memory success and 88.9% end-to-end success, versus 54.6% and 57.7% for FrameSamp, a raw-history VLM baseline using Gemini 3.7 Flash with the complete observation history and the same executor. In a controlled viewpoint-transfer test, OCC4M maintains 100% memory and 98% end-to-end success after a viewpoint change, while full-history FrameSamp falls to near-zero success. On 20 fixed-camera Franka episodes, OCC4M reaches 85% joint memory accuracy, versus at most 30% for FrameSamp across context sizes from K=16 to the complete history, and completes 45% of full two-stage tasks. These results support explicit object-centric memory for persistent spatiotemporal reasoning in long-horizon manipulation. Qualitative videos are available at https://occ4m-sup.github.io/occ4m-supplementary/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 7 of its 15 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
7 of 15 references.
References · 7
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 83
- 2015Memory-based control with recurrent neural networkscited by 78
- 20243D-Mem: 3D Scene Memory for Embodied Exploration and Reasoningcited by 75
- 2026Gated Memory Policy: In-Context Memorization and Adaptationcited by 14
- 2025Compose by Focus: Scene Graph-based Atomic Skillscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026In-Context Learning for Robots: Methods and Applicationscited by 1
- 2026In-Context Learning for Robots: Methods and Applications28 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulation
- 2026RoboStream: Weaving Spatio-Temporal Reasoning with Memory in Vision-Language Models for Robotics
- 2026MotionVLA: Injecting Geometric Motion into Vision-Language-Action Model
- 2026LT-Mem: Volatility-Aware Spatio-Temporal Memory for Lifelong Scene Understanding
- 2026Spatial Memory for Out-of-Vision Manipulation in Vision-Language-Action
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory
- 2025Rethinking Progression of Memory State in Robotic Manipulation: An Object-Centric Perspective
- 2026EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies