mlsanityData to 7 Oct 2026

PACO: Parts and Attributes of Common Objects

arXiv 2301.01795 ↗First posted 4 Jan 2023cs.CVcited by 146

Not on the map. Why?

Cited by 54 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Object models are gradually progressing from predicting just category labels to providing detailed descriptions of object instances. This motivates the need for large datasets which go beyond traditional object masks and provide richer annotations such as part masks and attributes. Hence, we introduce PACO: Parts and Attributes of Common Objects. It spans 75 object categories, 456 object-part categories and 55 attributes across image (LVIS) and video (Ego4D) datasets. We provide 641K part masks annotated across 260K object boxes, with roughly half of them exhaustively annotated with attributes as well. We design evaluation metrics and provide benchmark results for three tasks on the dataset: part mask segmentation, object and part attribute prediction and zero-shot instance detection. Dataset, models, and code are open-sourced at https://github.com/facebookresearch/paco.

Key facts. Cited by 146 papers in the map (data through 7 Oct 2026). Builds on 36 of its 62 references that are in the map. First posted on arXiv 4 Jan 2023.

Builds on

36 of 62 references.

References · 36

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  3. 2017Mask R-CNNcited by 7,259
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  6. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  7. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  8. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  9. 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
  10. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  11. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
  12. 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 897
24 more
  1. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
  2. 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
  3. 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 646
  4. 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
  5. 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 595
  6. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 542
  7. 2017Zero-Shot Learning -- The Good, the Bad and the Uglycited by 254
  8. 2016COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Imagescited by 235
  9. 2014Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Partscited by 230
  10. 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 170
  11. 2021OW-DETR: Open-world Detection Transformercited by 129
  12. 2020PhraseCut: Language-based Image Segmentation in the Wildcited by 116
  13. 2017Look into Person: Self-supervised Structure-sensitive Learning and A New Benchmark for Human Parsingcited by 109
  14. 2021PartImageNet: A Large, High-Quality Dataset of Partscited by 107
  15. 2021Learning to Predict Visual Attributes in the Wildcited by 95
  16. 2018ApolloCar3D: A Large 3D Car Instance Understanding Benchmark for Autonomous Drivingcited by 59
  17. 2020Fashionpedia: Ontology, Segmentation, and an Attribute Localization Datasetcited by 57
  18. 2018Parsing R-CNN for Instance-Level Human Analysiscited by 53
  19. 2020Cops-Ref: A new Dataset and Task on Compositional Referring Expression Comprehensioncited by 50
  20. 2019MULAN: Multitask Universal Lesion Analysis Network for Joint Lesion Detection, Tagging, and Segmentationcited by 39
  21. 2019The iMaterialist Fashion Attribute Datasetcited by 37
  22. 2016A Richly Annotated Dataset for Pedestrian Attribute Recognitioncited by 33
  23. 2018ModaNet: A Large-Scale Street Fashion Dataset with Polygon Annotationscited by 33
  24. 2020Cityscapes-Panoptic-Parts and PASCAL-Panoptic-Parts datasets for Scene Understandingcited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 24; 2024: 35; 2025: 50; 2026: 37.

146 papers.

Sort:

By area:

  1. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
  2. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  3. 2023Personalize Segment Anything Model with One Shotcited by 250
  4. 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 220
  5. 2023SegGPT: Segmenting Everything In Contextcited by 193
  6. 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
  7. 2023Physically Grounded Vision-Language Models for Robotic Manipulationcited by 163
  8. 2023Osprey: Pixel Understanding with Visual Instruction Tuningcited by 158
  9. 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 153
  10. 2023Matcher: Segment Anything with One Shot Using All-Purpose Feature Matchingcited by 142
  11. 2024VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Taskscited by 136
  12. 2024PSALM: Pixelwise SegmentAtion with Large Multi-Modal Modelcited by 100
38 more
  1. 2024One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videoscited by 99
  2. 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 98
  3. 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 85
  4. 2025Describe Anything: Detailed Localized Image and Video Captioningcited by 84
  5. 2023Fine-Grained Visual Promptingcited by 81
  6. 2024GROUNDHOG: Grounding Large Language Models to Holistic Segmentationcited by 70
  7. 2024SAM4MLLM: Enhance Multi-Modal Large Language Model for Referring Expression Segmentationcited by 68
  8. 2025Detect Anything via Next Point Predictioncited by 66
  9. 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 63
  10. 2024Code-as-Monitor: Constraint-aware Visual Programming for Reactive and Proactive Robotic Failure Detectioncited by 59
  11. 2023COLA: A Benchmark for Compositional Text-to-image Retrievalcited by 53
  12. 2024Visual Agents as Fast and Slow Thinkerscited by 53
  13. 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
  14. 2024VideoGLaMM: A Large Multimodal Model for Pixel-Level Visual Grounding in Videoscited by 51
  15. 2023See, Say, and Segment: Teaching LMMs to Overcome False Premisescited by 40
  16. 2023EgoObjects: A Large-Scale Egocentric Dataset for Fine-Grained Object Understandingcited by 39
  17. 2024Multi-modal Instruction Tuned LLMs with Fine-grained Visual Perceptioncited by 39
  18. 2024Bridge the Points: Graph-based Few-shot Segment Anything Semanticallycited by 35
  19. 2024ViGoR: Improving Visual Grounding of Large Vision Language Models with Fine-Grained Reward Modelingcited by 34
  20. 2023Tracking with Human-Intent Reasoningcited by 32
  21. 2024ChatRex: Taming Multimodal LLM for Joint Perception and Understandingcited by 30
  22. 2023The devil is in the fine-grained details: Evaluating open-vocabulary object detectors for fine-grained understandingcited by 29
  23. 2025Mechanistic understanding and validation of large AI models with SemanticLenscited by 29
  24. 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentationcited by 28
  25. 2025RoboOS: A Hierarchical Embodied Framework for Cross-Embodiment and Multi-Agent Collaborationcited by 28
  26. 2024Segment Anything without Supervisioncited by 27
  27. 2025UFO: A Unified Approach to Fine-grained Visual Perception via Open-ended Language Interfacecited by 27
  28. 2025The Devil is in Temporal Token: High Quality Video Reasoning Segmentationcited by 26
  29. 2024CoReS: Orchestrating the Dance of Reasoning and Segmentationcited by 25
  30. 2024SegLLM: Multi-round Reasoning Segmentationcited by 25
  31. 2023u-LLaVA: Unifying Multi-Modal Tasks via Large Language Modelcited by 24
  32. 2024MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuningcited by 22
  33. 2025POPEN: Preference-Based Optimization and Ensemble for LVLM-Based Reasoning Segmentationcited by 22
  34. 2023Unveiling Parts Beyond Objects:Towards Finer-Granularity Referring Expression Segmentationcited by 21
  35. 2025PixelRefer: A Unified Framework for Spatio-Temporal Object Referring with Arbitrary Granularitycited by 21
  36. 2025HiMTok: Learning Hierarchical Mask Tokens for Image Segmentation with Large Multimodal Modelcited by 19
  37. 2025Grasp Any Region: Towards Precise, Contextual Pixel Understanding for Multimodal LLMscited by 18
  38. 2023Towards Training-free Open-world Segmentation via Image Prompt Foundation Modelscited by 15

50 most cited of 146 All 146 (JSON)