FUNCanon: Learning Pose-Aware Action Primitives via Functional Object Canonicalization for Generalizable Robotic Manipulation
Not on the map. Why?
Abstract (arXiv)
General-purpose robotic skills from end-to-end demonstrations often leads to task-specific policies that fail to generalize beyond the training distribution. Therefore, we introduce FunCanon, a framework that converts long-horizon manipulation tasks into sequences of action chunks, each defined by an actor, verb, and object. These chunks focus policy learning on the actions themselves, rather than isolated tasks, enabling compositionality and reuse. To make policies pose-aware and category-general, we perform functional object canonicalization for functional alignment and automatic manipulation trajectory transfer, mapping objects into shared functional frames using affordance cues from large vision language models. An object centric and action centric diffusion policy FuncDiffuser trained on this aligned data naturally respects object affordances and poses, simplifying learning and improving generalization ability. Experiments on simulated and real-world benchmarks demonstrate category-level generalization, cross-task behavior reuse, and robust sim2real deployment, showing that functional canonicalization provides a strong inductive bias for scalable imitation learning in complex manipulation domains. Details of the demo and supplemental material are available on our project website https://sites.google.com/view/funcanon.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 26 of its 32 references that are in the map. First posted on arXiv 23 Sep 2025.
Builds on
26 of 32 references.
References · 26
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2016Deep Reinforcement Learning for Robotic Manipulation with Asynchronous Off-Policy Updatescited by 353
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 282
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 209
14 more
- 2023Generative Skill Chaining: Long-Horizon Skill Planning with Diffusion Modelscited by 91
- 20196-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypointscited by 78
- 2024AffordanceLLM: Grounding Affordance from Vision Language Modelscited by 55
- 2020Learning 3D Dynamic Scene Representations for Robot Manipulationcited by 39
- 2024SPOT: SE(3) Pose Trajectory Diffusion for Object-Centric Manipulationcited by 38
- 20253D-AffordanceLLM: Harnessing Large Language Models for Open-Vocabulary Affordance Detection in 3D Worldscited by 30
- 2025UAD: Unsupervised Affordance Distillation for Generalization in Robotic Manipulationcited by 23
- 2025Grounding 3D Object Affordance with Language Instructions, Visual Observations and Interactionscited by 19
- 2024ContactDexNet: Multi-fingered Robotic Hand Grasping in Cluttered Environments through Hand-object Contact Semantic Mappingcited by 11
- 2024ClearDepth: Enhanced Stereo Perception of Transparent Objects for Robotic Manipulationcited by 9
- 2024Close the Sim2real Gap via Physically-based Structured Light Synthetic Data Simulationcited by 6
- 2024ToolEENet: Tool Affordance 6D Pose Estimationcited by 4
- 2024Learning Instruction-Guided Manipulation Affordance via Large Models for Embodied Robotic Taskscited by 4
- 2024A Collision-Aware Cable Grasping Method in Cluttered Environmentcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026From Flow to One Step: Real-Time Multi-Modal Trajectory Policies via Implicit Maximum Likelihood Estimation-based Distribution Distillationcited by 4
- 2026Dynamics-Aware Meta-Imitation for Generalization to Unseen Robotic Manipulationcited by 0
- 2026SOS! : A Streamlined Object-Conditional Transformer for Model-free Segmentationcited by 0
- 2026SOS! : A Streamlined Object-Conditional Transformer for Model-free Segmentation15 Aug 2026
- 2026Dynamics-Aware Meta-Imitation for Generalization to Unseen Robotic Manipulation17 Jul 2026
- 2026From Flow to One Step: Real-Time Multi-Modal Trajectory Policies via Implicit Maximum Likelihood Estimation-based Distribution Distillation10 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2024Learning from 10 Demos: Generalisable and Sample-Efficient Policy Learning with Oriented Affordance Frames
- 2024AffordDP: Generalizable Diffusion Policy with Transferable Affordance
- 2026JoyAI-RA 0.5: Scaling Robot Manipulation Learning via Dual Action Alignment
- 2023Transferring Foundation Models for Generalizable Robotic Manipulation
- 2023Programmatically Grounded, Compositionally Generalizable Robotic Manipulation
- 2025Learning Compositional Behaviors from Demonstration and Language
- 2025Generalizable Hierarchical Skill Learning via Object-Centric Representation
- 2025Canonical Policy: Learning Canonical 3D Representation for SE(3)-Equivariant Policy