ConceptFactory: Facilitate 3D Object Knowledge Annotation with Object Conceptualization
Not on the map. Why?
Abstract (arXiv)
We present ConceptFactory, a novel scope to facilitate more efficient annotation of 3D object knowledge by recognizing 3D objects through generalized concepts (i.e. object conceptualization), aiming at promoting machine intelligence to learn comprehensive object knowledge from both vision and robotics aspects. This idea originates from the findings in human cognition research that the perceptual recognition of objects can be explained as a process of arranging generalized geometric components (e.g. cuboids and cylinders). ConceptFactory consists of two critical parts: i) ConceptFactory Suite, a unified toolbox that adopts Standard Concept Template Library (STL-C) to drive a web-based platform for object conceptualization, and ii) ConceptFactory Asset, a large collection of conceptualized objects acquired using ConceptFactory suite. Our approach enables researchers to effortlessly acquire or customize extensive varieties of object knowledge to comprehensively study different object understanding tasks. We validate our idea on a wide range of benchmark tasks from both vision and robotics aspects with state-of-the-art algorithms, demonstrating the high quality and versatility of annotations provided by our approach. Our website is available at https://apeirony.github.io/ConceptFactory.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 23 of its 53 references that are in the map. First posted on arXiv 1 Nov 2024.
Builds on
23 of 53 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2017Mask R-CNNcited by 7,277
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2020Point Transformercited by 1,470
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2020PCT: Point cloud transformercited by 732
11 more
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
- 2019Efficient Learning on Point Clouds with Basis Point Setscited by 103
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 82
- 2021AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-shot Interactionscited by 57
- 2023Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objectscited by 35
- 2024Discovering Conceptual Knowledge with Analytic Ontology Templates for Articulated Objectscited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 2.
6 papers.
- 2024Arti-PG: A Toolbox for Procedurally Synthesizing Large-Scale and Diverse Articulated Objects with Rich Annotationscited by 6
- 2025Digital Gene: Learning about the Physical World through Analytic Conceptscited by 3
- 2025VisionLaw: Inferring Interpretable Intrinsic Dynamics from Visual Observations via Bilevel Optimizationcited by 3
- 2025Executable Analytic Concepts as the Missing Link Between VLM Insight and Precise Manipulationcited by 3
- 2026Analytic Concept-Centric Memory for Agentic Embodied Manipulationcited by 1
- 2026Explicit Kinematic Guidance from Analytic Concepts for Vision-Language-Action Modelscited by 0
- 2026Explicit Kinematic Guidance from Analytic Concepts for Vision-Language-Action Models29 Jul 2026
- 2026Analytic Concept-Centric Memory for Agentic Embodied Manipulation29 Jun 2026
- 2025Executable Analytic Concepts as the Missing Link Between VLM Insight and Precise Manipulation9 Oct 2025
- 2025VisionLaw: Inferring Interpretable Intrinsic Dynamics from Visual Observations via Bilevel Optimization19 Aug 2025
- 2025Digital Gene: Learning about the Physical World through Analytic Concepts5 Apr 2025
- 2024Arti-PG: A Toolbox for Procedurally Synthesizing Large-Scale and Diverse Articulated Objects with Rich Annotations19 Dec 2024