PartImageNet: A Large, High-Quality Dataset of Parts
Not on the map. Why?
Cited by 20 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
It is natural to represent objects in terms of their parts. This has the potential to improve the performance of algorithms for object recognition and segmentation but can also help for downstream tasks like activity recognition. Research on part-based models, however, is hindered by the lack of datasets with per-pixel part annotations. This is partly due to the difficulty and high cost of annotating object parts so it has rarely been done except for humans (where there exists a big literature on part-based models). To help address this problem, we propose PartImageNet, a large, high-quality dataset with part segmentation annotations. It consists of 158 classes from ImageNet with approximately 24,000 images. PartImageNet is unique because it offers part-level annotations on a general set of classes including non-rigid, articulated objects, while having an order of magnitude larger size compared to existing part datasets (excluding datasets of humans). It can be utilized for many vision tasks including Object Segmentation, Semantic Part Segmentation, Few-shot Learning and Part Discovery. We conduct comprehensive experiments which study these tasks and set up a set of baselines. The dataset and scripts are released at https://github.com/TACJu/PartImageNet.
Key facts. Cited by 107 papers in the map (data through 14 Oct 2026). Builds on 36 of its 64 references that are in the map. First posted on arXiv 2 Dec 2021.
Builds on
36 of 64 references.
References · 36
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2019Panoptic Feature Pyramid Networkscited by 645
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2017Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)cited by 473
24 more
- 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
- 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 437
- 2014Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Partscited by 232
- 2020Meta-Baseline: Exploring Simple Meta-Learning for Few-Shot Learningcited by 179
- 2021Free Lunch for Few-shot Learning: Distribution Calibrationcited by 165
- 2020Part-aware Prototype Network for Few-shot Semantic Segmentationcited by 162
- 2018Instance-level Human Parsing via Part Grouping Networkcited by 134
- 2021TransFG: A Transformer Architecture for Fine-grained Recognitioncited by 132
- 2019SCOPS: Self-Supervised Co-Part Segmentationcited by 100
- 2018Look into Person: Joint Body Parsing & Pose Estimation Network and A New Benchmarkcited by 79
- 2018Unsupervised Discovery of Object Landmarks as Structural Representationscited by 73
- 2019Unsupervised Part-Based Disentangling of Object Shape and Appearancecited by 67
- 2017Unsupervised learning of object landmarks by factorized spatial embeddingscited by 64
- 2018Deep Feature Factorization For Concept Discoverycited by 64
- 2018Understanding Humans in Crowded Scenes: Deep Nested Adversarial Learning and A New Benchmark for Multi-Human Parsingcited by 60
- 2018ApolloCar3D: A Large 3D Car Instance Understanding Benchmark for Autonomous Drivingcited by 59
- 2021Part-aware Panoptic Segmentationcited by 56
- 2020DeepEMD: Differentiable Earth Mover's Distance for Few-Shot Learningcited by 49
- 2017Joint Multi-Person Pose Estimation and Semantic Part Segmentationcited by 41
- 2014Articulated Pose Estimation by a Graphical Model with Image Dependent Pairwise Relationscited by 24
- 2015Joint Object and Part Segmentation using Deep Learned Potentialscited by 23
- 2021FAPIS: A Few-shot Anchor-free Part-based Instance Segmentercited by 15
- 2015Unsupervised learning of object semantic parts from internal states of CNNs by population encodingcited by 8
- 2020Unsupervised Part Discovery by Unsupervised Disentanglementcited by 5
Built on by
Citing papers per year: 2022: 11; 2023: 16; 2024: 32; 2025: 34; 2026: 14.
107 papers.
Sort:
By area:
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2022What does a platypus look like? Generating customized prompts for zero-shot image classificationcited by 267
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
- 2023Osprey: Pixel Understanding with Visual Instruction Tuningcited by 159
- 2023PACO: Parts and Attributes of Common Objectscited by 146
- 2022Dataset Pruning: Reducing Training Data by Examining Generalization Influencecited by 133
- 2022SemMAE: Semantic-Guided Masking for Learning Masked Autoencoderscited by 114
- 2025Detect Anything via Next Point Predictioncited by 73
- 2024SAM4MLLM: Enhance Multi-Modal Large Language Model for Referring Expression Segmentationcited by 69
- 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 65
- 2024Visual Agents as Fast and Slow Thinkerscited by 53
38 more
- 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
- 2022Teaching Matters: Investigating the Role of Supervision in Vision Transformerscited by 45
- 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 44
- 2022Evaluation and Improvement of Interpretability for Self-Explainable Part-Prototype Networkscited by 37
- 2023Tracking with Human-Intent Reasoningcited by 33
- 2024DEEM: Diffusion Models Serve as the Eyes of Large Language Models for Image Perceptioncited by 32
- 2023Universal Segmentation at Arbitrary Granularity with Language Instructioncited by 29
- 2024Segment Anything without Supervisioncited by 28
- 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentationcited by 28
- 2023Unveiling Parts Beyond Objects:Towards Finer-Granularity Referring Expression Segmentationcited by 22
- 2023PDiscoNet: Semantically consistent part discovery for fine-grained recognitioncited by 21
- 2024Subobject-level Image Tokenizationcited by 21
- 2025PixelRefer: A Unified Framework for Spatio-Temporal Object Referring with Arbitrary Granularitycited by 21
- 2025HiMTok: Learning Hierarchical Mask Tokens for Image Segmentation with Large Multimodal Modelcited by 20
- 2022Recognizing Object by Components with Human Prior Knowledge Enhances Adversarial Robustness of Deep Neural Networkscited by 18
- 2022Learning Hierarchical Image Segmentation For Recognition and By Recognitioncited by 16
- 2024DCBM: Data-Efficient Visual Concept Bottleneck Modelscited by 16
- 2023Towards Open-World Segmentation of Partscited by 15
- 2024PartGLEE: A Foundation Model for Recognizing and Parsing Any Objectscited by 15
- 2024USE: Universal Segment Embeddings for Open-Vocabulary Image Segmentationcited by 14
- 2024DEAL: Disentangle and Localize Concept-level Explanations for VLMscited by 14
- 2024GraCo: Granularity-Controllable Interactive Segmentationcited by 13
- 2023From Posterior Sampling to Meaningful Diversity in Image Restorationcited by 12
- 2025Discovering Fine-Grained Visual-Concept Relations by Disentangled Optimal Transport Concept Bottleneck Modelscited by 12
- 2022Part-Based Models Improve Adversarial Robustnesscited by 11
- 2023Compositor: Bottom-up Clustering and Compositing for Robust Part and Object Segmentationcited by 11
- 2025GroundingSuite: Measuring Complex Multi-Granular Pixel Groundingcited by 11
- 2022Visual Recognition by Requestcited by 10
- 20243x2: 3D Object Part Segmentation by 2D Semantic Correspondencescited by 10
- 2024PDiscoFormer: Relaxing Part Discovery Constraints with Vision Transformerscited by 9
- 20252HandedAfforder: Learning Precise Actionable Bimanual Affordances from Human Videoscited by 9
- 2023Towards Open-Ended Visual Recognition with Large Language Modelcited by 8
- 2025Dissecting Embodied Abilities in Multimodal Language Models through Skill-level Evaluation and Diagnosiscited by 8
- 2023Structural Information Guided Multimodal Pre-training for Vehicle-centric Perceptioncited by 7
- 2024LLMBind: A Unified Modality-Task Integration Frameworkcited by 7
- 2024PEEB: Part-based Image Classifiers with an Explainable and Editable Language Bottleneckcited by 7
- 2024PartImageNet++ Dataset: Scaling up Part-based Models for Robust Recognitioncited by 7
- 2025PartEdit: Fine-Grained Image Editing using Pre-Trained Diffusion Modelscited by 7
50 most cited of 107 All 107 (JSON)
- 2026Seeing as Humans Do: Learning from Motion to Segment Anything Without Supervision30 Sep 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
- 2026Sequential Planning via Anchored Robotic Keypoints29 Jun 2026
- 2026OP3DSG: Open-Vocabulary Part-Aware 3D Scene Graph Generation for Real-World Environments29 Jun 2026
- 2026Listening makes Vision Clear for VLMs22 Jun 2026
- 2026RATS! Patches Talk Through Registers: Emergent Parts in Register Attention Transformers12 Jun 2026
- 2026COCOTree: A Dataset and Benchmark for Open Tree-Structured Visual Decomposition21 May 2026
- 2026SceneParser: Hierarchical Scene Parsing for Visual Semantics Understanding14 May 2026
- 2026Do Vision Transformers Need All-to-All Attention? Global Communication Through Elastic Learned Cores12 May 2026
- 2026I Walk the Line: Examining the Role of Gestalt Continuity in Object Binding for Vision Transformers10 Apr 2026
- 2026Excite, Attend and Segment (EASe): Domain-Agnostic Fine-Grained Mask Discovery with Feature Calibration and Self-Supervised Upsampling31 Mar 2026
- 2026AG-VAS: Anchor-Guided Zero-Shot Visual Anomaly Segmentation with Large Multimodal Models1 Mar 2026
38 more
- 2026Pixel-Grounded Retrieval for Knowledgeable Large Multimodal Models27 Jan 2026
- 2026PartImageNet++ Dataset: Enhancing Visual Models with High-Quality Part Annotations4 Jan 2026
- 2025Vehicle-centric Perception via Multimodal Structured Pre-training22 Dec 2025
- 2025Hierarchical Instance Tracking to Balance Privacy Preservation with Accessible Information10 Dec 2025
- 2025Better, Stronger, Faster: Tackling the Trilemma in MLLM-based Segmentation with Simultaneous Textual Mask Prediction29 Nov 2025
- 2025FaCT: Faithful Concept Traces for Explaining Neural Network Decisions29 Oct 2025
- 2025LangHOPS: Language Grounded Hierarchical Open-Vocabulary Part Segmentation29 Oct 2025
- 2025PixelRefer: A Unified Framework for Spatio-Temporal Object Referring with Arbitrary Granularity27 Oct 2025
- 2025Chimera: Compositional Image Generation using Part-based Concepting20 Oct 2025
- 2025Talking Points: Describing and Localizing Pixels16 Oct 2025
- 2025Detect Anything via Next Point Prediction14 Oct 2025
- 2025Dissecting Embodied Abilities in Multimodal Language Models through Skill-level Evaluation and Diagnosis9 Oct 2025
- 2025CoT Referring: Improving Referring Expression Tasks with Grounded Reasoning3 Oct 2025
- 2025Generating Part-Based Global Explanations Via Correspondence18 Sep 2025
- 20253DFroMLLM: 3D Prototype Generation only from Pretrained Multimodal LLMs12 Aug 2025
- 2025HRSeg: High-Resolution Visual Perception and Enhancement for Reasoning Segmentation17 Jul 2025
- 2025Unsupervised Part Discovery via Descriptor-Based Masked Image Restoration with Optimized Constraints16 Jul 2025
- 2025FOCUS: Unified Vision-Language Modeling for Interactive Editing Driven by Referential Segmentation20 Jun 2025
- 2025PARTONOMY: Large Multimodal Models with Part-Level Visual Understanding27 May 2025
- 2025SynRES: Towards Referring Expression Segmentation in the Wild via Synthetic Data23 May 2025
- 2025Ground-V: Teaching VLMs to Ground Complex Instructions in Pixels20 May 2025
- 2025Discovering Fine-Grained Visual-Concept Relations by Disentangled Optimal Transport Concept Bottleneck Models12 May 2025
- 2025D-Feat Occlusions: Diffusion Features for Robustness to Partial Visual Occlusions in Object Recognition8 Apr 2025
- 2025URECA: Unique Region Caption Anything7 Apr 2025
- 2025Towards Unified Referring Expression Segmentation Across Omni-Level Visual Target Granularities2 Apr 2025
- 2025RefCut: Interactive Segmentation with Reference Guidance22 Mar 2025
- 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentation18 Mar 2025
- 2025HiMTok: Learning Hierarchical Mask Tokens for Image Segmentation with Large Multimodal Model17 Mar 2025
- 2025GroundingSuite: Measuring Complex Multi-Granular Pixel Grounding13 Mar 2025
- 20252HandedAfforder: Learning Precise Actionable Bimanual Affordances from Human Videos12 Mar 2025
- 2025Hidden in Plain Sight -- Class Competition Focuses Attribution Maps10 Mar 2025
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar 2025
- 2025Dictionary-based Framework for Interpretable and Consistent Object Parsing26 Feb 2025
- 2025PartEdit: Fine-Grained Image Editing using Pre-Trained Diffusion Models6 Feb 2025
- 2025Fine-Grained Image-Text Correspondence with Cost Aggregation for Open-Vocabulary Part Segmentation16 Jan 2025
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generation7 Jan 2025
- 2024CALICO: Part-Focused Semantic Co-Segmentation with Large Vision-Language Models26 Dec 2024
- 2024DCBM: Data-Efficient Visual Concept Bottleneck Models16 Dec 2024
50 newest of 107 All 107 (JSON)
- 2023Osprey: Pixel Understanding with Visual Instruction Tuningcited by 159
- 2024SAM4MLLM: Enhance Multi-Modal Large Language Model for Referring Expression Segmentationcited by 69
- 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 65
- 2024DEEM: Diffusion Models Serve as the Eyes of Large Language Models for Image Perceptioncited by 32
- 2025PixelRefer: A Unified Framework for Spatio-Temporal Object Referring with Arbitrary Granularitycited by 21
- 2025HiMTok: Learning Hierarchical Mask Tokens for Image Segmentation with Large Multimodal Modelcited by 20
- 2024DEAL: Disentangle and Localize Concept-level Explanations for VLMscited by 14
- 2025Dissecting Embodied Abilities in Multimodal Language Models through Skill-level Evaluation and Diagnosiscited by 8
- 2024LLMBind: A Unified Modality-Task Integration Frameworkcited by 7
- 2025Better, Stronger, Faster: Tackling the Trilemma in MLLM-based Segmentation with Simultaneous Textual Mask Predictioncited by 7
- 2024CALICO: Part-Focused Semantic Co-Segmentation with Large Vision-Language Modelscited by 4
- 2025PARTONOMY: Large Multimodal Models with Part-Level Visual Understandingcited by 4
12 most cited of 18 All 18 (JSON)
- 2026AG-VAS: Anchor-Guided Zero-Shot Visual Anomaly Segmentation with Large Multimodal Models1 Mar 2026
- 2026Pixel-Grounded Retrieval for Knowledgeable Large Multimodal Models27 Jan 2026
- 2025Better, Stronger, Faster: Tackling the Trilemma in MLLM-based Segmentation with Simultaneous Textual Mask Prediction29 Nov 2025
- 2025LangHOPS: Language Grounded Hierarchical Open-Vocabulary Part Segmentation29 Oct 2025
- 2025PixelRefer: A Unified Framework for Spatio-Temporal Object Referring with Arbitrary Granularity27 Oct 2025
- 2025Talking Points: Describing and Localizing Pixels16 Oct 2025
- 2025Dissecting Embodied Abilities in Multimodal Language Models through Skill-level Evaluation and Diagnosis9 Oct 2025
- 20253DFroMLLM: 3D Prototype Generation only from Pretrained Multimodal LLMs12 Aug 2025
- 2025FOCUS: Unified Vision-Language Modeling for Interactive Editing Driven by Referential Segmentation20 Jun 2025
- 2025PARTONOMY: Large Multimodal Models with Part-Level Visual Understanding27 May 2025
- 2025HiMTok: Learning Hierarchical Mask Tokens for Image Segmentation with Large Multimodal Model17 Mar 2025
- 2024CALICO: Part-Focused Semantic Co-Segmentation with Large Vision-Language Models26 Dec 2024
12 newest of 18 All 18 (JSON)
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
- 2024Visual Agents as Fast and Slow Thinkerscited by 53
- 2023Tracking with Human-Intent Reasoningcited by 33
- 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentationcited by 28
- 2025CoT Referring: Improving Referring Expression Tasks with Grounded Reasoningcited by 5
- 2025CoT Referring: Improving Referring Expression Tasks with Grounded Reasoning3 Oct 2025
- 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentation18 Mar 2025
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar 2025
- 2024Visual Agents as Fast and Slow Thinkers16 Aug 2024
- 2023Tracking with Human-Intent Reasoning29 Dec 2023
- 2023LISA: Reasoning Segmentation via Large Language Model1 Aug 2023
- 2026Sequential Planning via Anchored Robotic Keypointscited by 2
- 2026Sequential Planning via Anchored Robotic Keypoints29 Jun 2026
- 2022What does a platypus look like? Generating customized prompts for zero-shot image classificationcited by 267
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
- 2023PACO: Parts and Attributes of Common Objectscited by 146
- 2022Dataset Pruning: Reducing Training Data by Examining Generalization Influencecited by 133
- 2022SemMAE: Semantic-Guided Masking for Learning Masked Autoencoderscited by 114
- 2025Detect Anything via Next Point Predictioncited by 73
- 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
- 2022Teaching Matters: Investigating the Role of Supervision in Vision Transformerscited by 45
- 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 44
- 2022Evaluation and Improvement of Interpretability for Self-Explainable Part-Prototype Networkscited by 37
- 2023Universal Segmentation at Arbitrary Granularity with Language Instructioncited by 29
- 2024Segment Anything without Supervisioncited by 28
12 most cited of 80 All 80 (JSON)
- 2026Seeing as Humans Do: Learning from Motion to Segment Anything Without Supervision30 Sep 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
- 2026OP3DSG: Open-Vocabulary Part-Aware 3D Scene Graph Generation for Real-World Environments29 Jun 2026
- 2026Listening makes Vision Clear for VLMs22 Jun 2026
- 2026RATS! Patches Talk Through Registers: Emergent Parts in Register Attention Transformers12 Jun 2026
- 2026COCOTree: A Dataset and Benchmark for Open Tree-Structured Visual Decomposition21 May 2026
- 2026SceneParser: Hierarchical Scene Parsing for Visual Semantics Understanding14 May 2026
- 2026Do Vision Transformers Need All-to-All Attention? Global Communication Through Elastic Learned Cores12 May 2026
- 2026I Walk the Line: Examining the Role of Gestalt Continuity in Object Binding for Vision Transformers10 Apr 2026
- 2026Excite, Attend and Segment (EASe): Domain-Agnostic Fine-Grained Mask Discovery with Feature Calibration and Self-Supervised Upsampling31 Mar 2026
- 2026PartImageNet++ Dataset: Enhancing Visual Models with High-Quality Part Annotations4 Jan 2026
- 2025Vehicle-centric Perception via Multimodal Structured Pre-training22 Dec 2025
12 newest of 80 All 80 (JSON)