AffordGen: Generating Diverse Demonstrations for Generalizable Object Manipulation with Afford Correspondence
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
Abstract (arXiv)
Despite the recent success of modern imitation learning methods in robot manipulation, their performance is often constrained by geometric variations due to limited data diversity. Leveraging powerful 3D generative models and vision foundation models (VFMs), the proposed AffordGen framework overcomes this limitation by utilizing the semantic correspondence of meaningful keypoints across large-scale 3D meshes to generate new robot manipulation trajectories. This large-scale, affordance-aware dataset is then used to train a robust, closed-loop visuomotor policy, combining the semantic generalizability of affordances with the reactive robustness of end-to-end learning. Experiments in simulation and the real world show that policies trained with AffordGen achieve high success rates and enable zero-shot generalization to truly unseen objects, significantly improving data efficiency in robot learning. Project Page: https://jiaweiz9.github.io/AffordGen-release/
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 35 of its 37 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
35 of 37 references.
Closest ancestors · 8
Same direction, newest first
- 2025A Careful Examination of Large Behavior Models for Multitask Dexterous Manipulation7 Jul
- 2025FUNCTO: Function-Centric One-Shot Imitation Learning for Tool Manipulation17 Feb
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning31 Oct
- 2024SkillMimicGen: Automated Demonstration Generation for Efficient Skill Learning and Deployment24 Oct
- 2024Data Scaling Laws in Imitation Learning for Robotic Manipulation24 Oct
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations26 Oct
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Play24 Feb
- 2022CACTI: A Framework for Scalable Multi-Task Multi-Scene Visual Imitation Learning12 Dec
Other references · 27
- 2023Segment Anythingcited by 8,234
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2023Emergent Correspondence from Image Diffusioncited by 446
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 301
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 209
- 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 177
- 2019kPAM: KeyPoint Affordances for Category-Level Robotic Manipulationcited by 153
- 2018Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulationcited by 142
15 more
- 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 125
- 2023GenAug: Retargeting behaviors to unseen situations via Generative Augmentationcited by 104
- 2024Robo-ABC: Affordance Generalization Beyond Categories via Semantic Correspondence for Robot Manipulationcited by 71
- 2025DemoGen: Synthetic Demonstration Generation for Data-Efficient Visuomotor Policy Learningcited by 69
- 2025OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraintscited by 59
- 2024RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulationcited by 58
- 2024GenSim2: Scaling Robot Data Generation with Multi-modal and Reasoning LLMscited by 52
- 2024Omni6DPose: A Benchmark and Model for Universal 6D Object Pose Estimation and Trackingcited by 50
- 2024HRP: Human Affordances for Robotic Pre-Trainingcited by 44
- 2024AffordDP: Generalizable Diffusion Policy with Transferable Affordancecited by 37
- 2024DenseMatcher: Learning 3D Semantic Correspondence for Category-Level Manipulation from a Single Democited by 34
- 2023RL-ViGen: A Reinforcement Learning Benchmark for Visual Generalizationcited by 28
- 2025MimicFunc: Imitating Tool Manipulation from a Single Human Video via Functional Correspondencecited by 13
- 2025Constraint-Preserving Data Generation for Visuomotor Policy Learningcited by 6
- 2024Stem-OB: Generalizable Visual Imitation Learning with Stem-Like Convergent Observation through Diffusion Inversioncited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026AffordTrajDP: Dynamic Affordance-Guided Visuomotor Policy Learning for Robotic Manipulation
- 2026AffordSim: A Scalable Data Generator and Benchmark for Affordance-Aware Robotic Manipulation
- 2025UAD: Unsupervised Affordance Distillation for Generalization in Robotic Manipulation
- 2024Affordance-based Robot Manipulation with Flow Matching
- 2026AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding
- 2024KALIE: Fine-Tuning Vision-Language Models for Open-World Manipulation without Robot Data
- 2024Learning from 10 Demos: Generalisable and Sample-Efficient Policy Learning with Oriented Affordance Frames
- 2022Learning Generalizable Dexterous Manipulation from Human Grasp Affordance