mlsanityData to 7 Oct 2026

GPA-RAM: Grasp-Pretraining Augmented Robotic Attention Mamba for Spatial Task Learning

arXiv 2504.19683 ↗First posted 28 Apr 2025cs.ROcited by 1

On the map: State-space sequence models (S4, Mamba) → Video, motion and generative Mamba models

Abstract (arXiv)

Fine-grained robotic manipulation often fails when inaccurate initial grasps propagate errors and necessitate complex pose correction. We propose Grasp-Pretraining Augmentation (GPA), which incorporates grasp priors from task demonstrations into imitation policies without additional grasp-pose data or annotation. When added to RVT2, GPA raises the average success rate on RLBench from 79.3% to 84.2%. When added to ACT, it raises success on ALOHA cube transfer and bimanual insertion from 86% and 16% to 98% and 38%, respectively. To offset added computational costs, we develop Robotic Attention Mamba (RAM) for real-time deployment. RAM combines attention-based spatial feature extraction with state-space modeling to capture long-range dependencies efficiently. The resulting GPA-RAM framework supports discrete keyframe prediction and continuous action generation. We evaluate it on four platforms, including physical UR5 and ARX R5 systems. GPA-RAM achieves an average success rate of 87.5% on RLBench, outperforming RVT2 and ARP+ by 8.2 and 2.6 percentage points, respectively. On ALOHA, it achieves 98% success in cube transfer and 56% in bimanual insertion, improvements of 12 and 40 percentage points over ACT, while operating at approximately 71 frames per second. These results demonstrate that GPA-RAM combines precise manipulation with efficient real-time robotic execution. Code is available at https://gpa-ram.github.io/.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video, motion and generative Mamba models, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 43 of its 64 references that are in the map. First posted on arXiv 28 Apr 2025.

Builds on

43 of 64 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation6 Jun

Other references · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  7. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  8. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  9. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  10. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  11. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  12. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
30 more
  1. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  2. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
  3. 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
  4. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  5. 2022Behavior Transformers: Cloning k modes with one stonecited by 299
  6. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
  7. 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
  8. 2023Any-point Trajectory Modeling for Policy Learningcited by 207
  9. 2021Efficient Self-supervised Vision Transformers for Representation Learningcited by 149
  10. 2021The Surprising Effectiveness of Representation Learning for Visual Imitationcited by 149
  11. 2022What Matters in Language Conditioned Robotic Imitation Learning over Unstructured Datacited by 137
  12. 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 135
  13. 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 135
  14. 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 120
  15. 2022Instruction-driven history-aware policies for robotic manipulationscited by 93
  16. 2024FreqMamba: Viewing Mamba from a Frequency Perspective for Image Derainingcited by 57
  17. 2023PolarNet: 3D Point Clouds for Language-Guided Robotic Manipulationcited by 56
  18. 2023Towards Generalizable Zero-Shot Manipulation via Translating Human Interaction Planscited by 51
  19. 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Placecited by 40
  20. 2024GR-MG: Leveraging Partially Annotated Data via Multi-Modal Goal-Conditioned Policycited by 39
  21. 2021kPAM 2.0: Feedback Control for Category-Level Robotic Manipulationcited by 38
  22. 2024Learning Manipulation by Predicting Interactioncited by 36
  23. 2024Autoregressive Action Sequence Learning for Robotic Manipulationcited by 26
  24. 2024FoundationGrasp: Generalizable Task-Oriented Grasping with Foundation Modelscited by 16
  25. 2025FlexVLN: Flexible Adaptation for Diverse Vision-and-Language Navigation Taskscited by 16
  26. 2024Contrastive Imitation Learning for Language-guided Multi-Task Robotic Manipulationcited by 15
  27. 2024DexH2R: Task-oriented Dexterous Manipulation from Human to Robotscited by 11
  28. 2024Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Priorcited by 5
  29. 2024OpenSlot: Mixed Open-Set Recognition with Object-Centric Learningcited by 2
  30. 2022Learning to Reorient Objects with Stable Placements Afforded by Extrinsic Supportscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Spatial RoboGrasp: Generalized Robotic Grasping Control Policy
  2. 2024GraspMamba: A Mamba-based Language-driven Grasp Detection Framework with Hierarchical Feature Learning
  3. 2025MAP-VLA: Memory-Augmented Prompting for Vision-Language-Action Model in Robotic Manipulation
  4. 2024HMT-Grasp: A Hybrid Mamba-Transformer Approach for Robot Grasping in Cluttered Environments
  5. 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Data
  6. 2025ORACLE-Grasp: Zero-Shot Affordance-Aligned Robotic Grasping using Large Multimodal Models
  7. 2026AffordSim: A Scalable Data Generator and Benchmark for Affordance-Aware Robotic Manipulation
  8. 2024GLOVER: Generalizable Open-Vocabulary Affordance Reasoning for Task-Oriented Grasping