Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Parts
Not on the map. Why?
Cited by 27 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Detecting objects becomes difficult when we need to deal with large shape deformation, occlusion and low resolution. We propose a novel approach to i) handle large deformations and partial occlusions in animals (as examples of highly deformable objects), ii) describe them in terms of body parts, and iii) detect them when their body parts are hard to detect (e.g., animals depicted at low resolution). We represent the holistic object and body parts separately and use a fully connected model to arrange templates for the holistic object and body parts. Our model automatically decouples the holistic object or body parts from the model when they are hard to detect. This enables us to represent a large number of holistic object and body part combinations to better deal with different "detectability" patterns caused by deformations, occlusion and/or low resolution. We apply our method to the six animal categories in the PASCAL VOC dataset and show that our method significantly improves state-of-the-art (by 4.1% AP) and provides a richer representation for objects. During training we use annotations for body parts (e.g., head, torso, etc), making use of a new dataset of fully annotated object parts for PASCAL VOC 2010, which provides a mask for each part.
Key facts. Cited by 230 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Jun 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 28; 2023: 53; 2024: 45; 2025: 53; 2026: 23.
230 papers.
Sort:
By area:
- 2022Token Merging: Your ViT But Fastercited by 995
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
- 2023Osprey: Pixel Understanding with Visual Instruction Tuningcited by 158
- 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 153
- 2023PACO: Parts and Attributes of Common Objectscited by 146
- 2023Matcher: Segment Anything with One Shot Using All-Purpose Feature Matchingcited by 142
- 2022SemMAE: Semantic-Guided Masking for Learning Masked Autoencoderscited by 113
- 2021PartImageNet: A Large, High-Quality Dataset of Partscited by 107
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
- 2024PSALM: Pixelwise SegmentAtion with Large Multi-Modal Modelcited by 100
38 more
- 2024One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videoscited by 99
- 2022InvPT: Inverted Pyramid Multi-task Transformer for Dense Scene Understandingcited by 89
- 2021Repurposing GANs for One-shot Semantic Part Segmentationcited by 88
- 2023Fine-Grained Visual Promptingcited by 81
- 2021Exploring Relational Context for Multi-Task Dense Predictioncited by 71
- 2024SAM4MLLM: Enhance Multi-Modal Large Language Model for Referring Expression Segmentationcited by 68
- 2022LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discoverycited by 65
- 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 63
- 2023Concept Decomposition for Visual Exploration and Inspirationcited by 61
- 2022Factorizing Knowledge in Neural Networkscited by 59
- 2024Code-as-Monitor: Constraint-aware Visual Programming for Reactive and Proactive Robotic Failure Detectioncited by 59
- 2024Multi-Task Dense Prediction via Mixture of Low-Rank Expertscited by 58
- 2021Unsupervised Part Discovery from Contrastive Reconstructioncited by 57
- 2021Part-aware Panoptic Segmentationcited by 56
- 2024Visual Agents as Fast and Slow Thinkerscited by 53
- 2022OPD: Single-view 3D Openable Part Detectioncited by 52
- 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
- 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotationscited by 51
- 2023PLIP: Language-Image Pre-training for Person Representation Learningcited by 49
- 2021OOD-CV: A Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Imagescited by 46
- 2023TaskExpert: Dynamically Assembling Multi-Task Representations with Memorial Mixture-of-Expertscited by 45
- 2021Learning Multiple Dense Prediction Tasks from Partially Annotated Datacited by 42
- 2024Bridge the Points: Graph-based Few-shot Segment Anything Semanticallycited by 35
- 2022Multi-Task Learning with Multi-Query Transformer for Dense Predictioncited by 34
- 2023SLiMe: Segment Like Mecited by 34
- 2023Tracking with Human-Intent Reasoningcited by 32
- 2024DEEM: Diffusion Models Serve as the Eyes of Large Language Models for Image Perceptioncited by 32
- 2023OV-PARTS: Towards Open-Vocabulary Part Segmentationcited by 31
- 2021EXplainable Neural-Symbolic Learning (X-NeSyL) methodology to fuse deep learning representations with expert knowledge graphs: the MonuMAI cultural heritage use casecited by 30
- 2022Hi-LASSIE: High-Fidelity Articulated Shape and Skeleton Discovery from Sparse Image Ensemblecited by 30
- 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentationcited by 28
- 2023DeMT: Deformable Mixer Transformer for Multi-Task Learning of Dense Predictioncited by 27
- 2025UFO: A Unified Approach to Fine-grained Visual Perception via Open-ended Language Interfacecited by 27
- 2022Versatile Multi-Modal Pre-Training for Human-Centric Perceptioncited by 26
- 2025The Devil is in Temporal Token: High Quality Video Reasoning Segmentationcited by 26
- 2024CoReS: Orchestrating the Dance of Reasoning and Segmentationcited by 25
- 2023ARTIC3D: Learning Robust Articulated 3D Shapes from Noisy Web Image Collectionscited by 22
- 2023InvPT++: Inverted Pyramid Multi-Task Transformer for Visual Scene Understandingcited by 22
50 most cited of 230 All 230 (JSON)
- 2026Task-State Adaptation with Prototype Memory for Multi-Task Dense Prediction28 Aug 2026
- 2026Unified Video Dense Prediction from Disjoint Data23 Jul 2026
- 2026Low-cost concept-based localized explanations: How far can we get with training-free approaches?27 Jun 2026
- 2026Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Parts19 Jun 2026
- 2026GLARE: A Natural Language Interface for Querying Global Explanations18 Jun 2026
- 2026Unlocking Diffusion Hierarchies: Adaptive Timestep Selection for Zero-Shot Segmentation14 Jun 2026
- 2026Unsupervised Semantic Segmentation Facilitates Model Understanding28 May 2026
- 2026Category-Level 3D Correspondence in Camera Space via Morphable Object Priors27 May 2026
- 2026COCOTree: A Dataset and Benchmark for Open Tree-Structured Visual Decomposition21 May 2026
- 2026Vision Harnessing Agent for Open Ad-hoc Segmentation19 May 2026
- 2026SceneParser: Hierarchical Scene Parsing for Visual Semantics Understanding14 May 2026
- 2026B3-Net: Controlled Posterior Bridge Learning for Multi-Task Dense Prediction7 May 2026
38 more
- 2026AnchorSeg: Language Grounded Query Banks for Reasoning Segmentation20 Apr 2026
- 2026PR-MaGIC: Prompt Refinement Via Mask Decoder Gradient Flow For In-Context Segmentation13 Apr 2026
- 2026Online Reasoning Video Object Segmentation13 Apr 2026
- 2026VIRST: Video-Instructed Reasoning Assistant for SpatioTemporal Segmentation28 Mar 2026
- 2026Rethinking MLLM Itself as a Segmenter with a Single Segmentation Token19 Mar 2026
- 2026PCA-Seg: Revisiting Cost Aggregation for Open-Vocabulary Semantic and Part Segmentation18 Mar 2026
- 2026AG-VAS: Anchor-Guided Zero-Shot Visual Anomaly Segmentation with Large Multimodal Models1 Mar 2026
- 2026UV-M3TL: A Unified and Versatile Multimodal Multi-Task Learning Framework for Assistive Driving Perception2 Feb 2026
- 2026Pixel-Grounded Retrieval for Knowledgeable Large Multimodal Models27 Jan 2026
- 2026Local-to-Global Logical Explanations for Deep Vision Models19 Jan 2026
- 2026PartImageNet++ Dataset: Enhancing Visual Models with High-Quality Part Annotations4 Jan 2026
- 2025Simplifying Multi-Task Architectures Through Task-Specific Normalization23 Dec 2025
- 2025Grounding Everything in Tokens for Multimodal Large Language Models11 Dec 2025
- 2025Hierarchical Instance Tracking to Balance Privacy Preservation with Accessible Information10 Dec 2025
- 2025VisKnow: Constructing Visual Knowledge Base for Object Understanding9 Dec 2025
- 2025Better, Stronger, Faster: Tackling the Trilemma in MLLM-based Segmentation with Simultaneous Textual Mask Prediction29 Nov 2025
- 20253D-Aware Multi-Task Learning with Cross-View Correlations for Dense Scene Understanding25 Nov 2025
- 2025Parameter Aware Mamba Model for Multi-task Dense Prediction18 Nov 2025
- 2025Another BRIXEL in the Wall: Towards Cheaper Dense Features7 Nov 2025
- 2025LangHOPS: Language Grounded Hierarchical Open-Vocabulary Part Segmentation29 Oct 2025
- 2025PixelRefer: A Unified Framework for Spatio-Temporal Object Referring with Arbitrary Granularity27 Oct 2025
- 2025Segmentation as A Plug-and-Play Capability for Frozen Multimodal LLMs19 Oct 2025
- 2025SaFiRe: Saccade-Fixation Reiteration with Mamba for Referring Image Segmentation11 Oct 2025
- 2025CE-FAM: Concept-Based Explanation via Fusion of Activation Maps28 Sep 2025
- 2025Parameter-Efficient Multi-Task Learning via Progressive Task-Specific Adaptation23 Sep 2025
- 2025Which Direction to Choose? An Analysis on the Representation Power of Self-Supervised ViTs in Downstream Tasks18 Sep 2025
- 2025Improving Generalized Visual Grounding with Instance-aware Joint Learning17 Sep 2025
- 2025Leveraging Multi-View Weak Supervision for Occlusion-Aware Multi-Human Parsing12 Sep 2025
- 2025HERO-VQL: Hierarchical, Egocentric and Robust Visual Query Localization30 Aug 2025
- 2025Enhancing Mamba Decoder with Bidirectional Interaction in Multi-Task Dense Prediction28 Aug 2025
- 2025RynnEC: Bringing MLLMs into Embodied World19 Aug 2025
- 2025GECO: Geometrically Consistent Embedding with Lightspeed Inference1 Aug 2025
- 2025Fine-grained Spatiotemporal Grounding on Egocentric Videos1 Aug 2025
- 2025Towards Omnimodal Expressions and Reasoning in Referring Audio-Visual Segmentation30 Jul 2025
- 2025Object Recognition Datasets and Challenges: A Review30 Jul 2025
- 2025Object-centric Video Question Answering with Visual Grounding and Referring25 Jul 2025
- 2025Multi-Task Dense Prediction Fine-Tuning with Mixture of Fine-Grained Experts25 Jul 2025
- 2025Part Segmentation of Human Meshes via Multi-View Human Parsing22 Jul 2025
50 newest of 230 All 230 (JSON)
- 2023Osprey: Pixel Understanding with Visual Instruction Tuningcited by 158
- 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 153
- 2024PSALM: Pixelwise SegmentAtion with Large Multi-Modal Modelcited by 100
- 2023Fine-Grained Visual Promptingcited by 81
- 2024SAM4MLLM: Enhance Multi-Modal Large Language Model for Referring Expression Segmentationcited by 68
- 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 63
- 2023SLiMe: Segment Like Mecited by 34
- 2024DEEM: Diffusion Models Serve as the Eyes of Large Language Models for Image Perceptioncited by 32
- 2025PixelRefer: A Unified Framework for Spatio-Temporal Object Referring with Arbitrary Granularitycited by 21
- 2025RynnEC: Bringing MLLMs into Embodied Worldcited by 11
- 2025Vision-Language Model for Object Detection and Segmentation: A Review and Evaluationcited by 10
- 2024Instruction-guided Multi-Granularity Segmentation and Captioning with Large Multimodal Modelcited by 8
12 most cited of 23 All 23 (JSON)
- 2026Rethinking MLLM Itself as a Segmenter with a Single Segmentation Token19 Mar 2026
- 2026PCA-Seg: Revisiting Cost Aggregation for Open-Vocabulary Semantic and Part Segmentation18 Mar 2026
- 2026AG-VAS: Anchor-Guided Zero-Shot Visual Anomaly Segmentation with Large Multimodal Models1 Mar 2026
- 2026Pixel-Grounded Retrieval for Knowledgeable Large Multimodal Models27 Jan 2026
- 2025Grounding Everything in Tokens for Multimodal Large Language Models11 Dec 2025
- 2025Better, Stronger, Faster: Tackling the Trilemma in MLLM-based Segmentation with Simultaneous Textual Mask Prediction29 Nov 2025
- 2025LangHOPS: Language Grounded Hierarchical Open-Vocabulary Part Segmentation29 Oct 2025
- 2025PixelRefer: A Unified Framework for Spatio-Temporal Object Referring with Arbitrary Granularity27 Oct 2025
- 2025Segmentation as A Plug-and-Play Capability for Frozen Multimodal LLMs19 Oct 2025
- 2025RynnEC: Bringing MLLMs into Embodied World19 Aug 2025
- 2025FOCUS: Unified Vision-Language Modeling for Interactive Editing Driven by Referential Segmentation20 Jun 2025
- 2025PARTONOMY: Large Multimodal Models with Part-Level Visual Understanding27 May 2025
12 newest of 23 All 23 (JSON)
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
- 2024One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videoscited by 99
- 2024Visual Agents as Fast and Slow Thinkerscited by 53
- 2023Tracking with Human-Intent Reasoningcited by 32
- 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentationcited by 28
- 2025The Devil is in Temporal Token: High Quality Video Reasoning Segmentationcited by 26
- 2024CoReS: Orchestrating the Dance of Reasoning and Segmentationcited by 25
- 2025Towards Omnimodal Expressions and Reasoning in Referring Audio-Visual Segmentationcited by 10
- 2022Zero-shot visual reasoning through probabilistic analogical mappingcited by 8
- 2024Empowering Segmentation Ability to Multi-modal Large Language Modelscited by 8
- 2024Reasoning to Attend: Try to Understand How <SEG> Token Workscited by 2
- 2022Differentiable Fuzzy ALC: A Neural-Symbolic Representation Language for Symbol Groundingcited by 1
12 most cited of 13 All 13 (JSON)
- 2026VIRST: Video-Instructed Reasoning Assistant for SpatioTemporal Segmentation28 Mar 2026
- 2025Towards Omnimodal Expressions and Reasoning in Referring Audio-Visual Segmentation30 Jul 2025
- 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentation18 Mar 2025
- 2025The Devil is in Temporal Token: High Quality Video Reasoning Segmentation15 Jan 2025
- 2024Reasoning to Attend: Try to Understand How <SEG> Token Works23 Dec 2024
- 2024One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos29 Sep 2024
- 2024Visual Agents as Fast and Slow Thinkers16 Aug 2024
- 2024CoReS: Orchestrating the Dance of Reasoning and Segmentation8 Apr 2024
- 2024Empowering Segmentation Ability to Multi-modal Large Language Models21 Mar 2024
- 2023Tracking with Human-Intent Reasoning29 Dec 2023
- 2023LISA: Reasoning Segmentation via Large Language Model1 Aug 2023
- 2022Differentiable Fuzzy ALC: A Neural-Symbolic Representation Language for Symbol Grounding22 Nov 2022
12 newest of 13 All 13 (JSON)
- 2024MTMamba: Enhancing Multi-Task Dense Scene Understanding by Mamba-Based Decoderscited by 22
- 2024MTMamba++: Enhancing Multi-Task Dense Scene Understanding via Mamba-Based Decoderscited by 10
- 2025SaFiRe: Saccade-Fixation Reiteration with Mamba for Referring Image Segmentationcited by 3
- 2025Enhancing Mamba Decoder with Bidirectional Interaction in Multi-Task Dense Predictioncited by 1
- 2025Parameter Aware Mamba Model for Multi-task Dense Predictioncited by 0
- 2026B3-Net: Controlled Posterior Bridge Learning for Multi-Task Dense Predictioncited by 0
- 2026B3-Net: Controlled Posterior Bridge Learning for Multi-Task Dense Prediction7 May 2026
- 2025Parameter Aware Mamba Model for Multi-task Dense Prediction18 Nov 2025
- 2025SaFiRe: Saccade-Fixation Reiteration with Mamba for Referring Image Segmentation11 Oct 2025
- 2025Enhancing Mamba Decoder with Bidirectional Interaction in Multi-Task Dense Prediction28 Aug 2025
- 2024MTMamba++: Enhancing Multi-Task Dense Scene Understanding via Mamba-Based Decoders27 Aug 2024
- 2024MTMamba: Enhancing Multi-Task Dense Scene Understanding by Mamba-Based Decoders2 Jul 2024
- 2023ARTIC3D: Learning Robust Articulated 3D Shapes from Noisy Web Image Collectionscited by 22
- 2024Concept Replacer: Replacing Sensitive Concepts in Diffusion Models via Precision Localizationcited by 9
- 2025D-Feat Occlusions: Diffusion Features for Robustness to Partial Visual Occlusions in Object Recognitioncited by 2
- 2026Unlocking Diffusion Hierarchies: Adaptive Timestep Selection for Zero-Shot Segmentationcited by 1
- 2026Unlocking Diffusion Hierarchies: Adaptive Timestep Selection for Zero-Shot Segmentation14 Jun 2026
- 2025D-Feat Occlusions: Diffusion Features for Robustness to Partial Visual Occlusions in Object Recognition8 Apr 2025
- 2024Concept Replacer: Replacing Sensitive Concepts in Diffusion Models via Precision Localization2 Dec 2024
- 2023ARTIC3D: Learning Robust Articulated 3D Shapes from Noisy Web Image Collections7 Jun 2023
- 2026Vision Harnessing Agent for Open Ad-hoc Segmentationcited by 1
- 2026Vision Harnessing Agent for Open Ad-hoc Segmentation19 May 2026
- 2022Token Merging: Your ViT But Fastercited by 995
- 2022Token Merging: Your ViT But Faster17 Oct 2022
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
- 2023PACO: Parts and Attributes of Common Objectscited by 146
- 2023Matcher: Segment Anything with One Shot Using All-Purpose Feature Matchingcited by 142
- 2022SemMAE: Semantic-Guided Masking for Learning Masked Autoencoderscited by 113
- 2021PartImageNet: A Large, High-Quality Dataset of Partscited by 107
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
- 2022InvPT: Inverted Pyramid Multi-task Transformer for Dense Scene Understandingcited by 89
- 2021Repurposing GANs for One-shot Semantic Part Segmentationcited by 88
- 2021Exploring Relational Context for Multi-Task Dense Predictioncited by 71
- 2022LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discoverycited by 65
- 2023Concept Decomposition for Visual Exploration and Inspirationcited by 61
12 most cited of 178 All 178 (JSON)
- 2026Task-State Adaptation with Prototype Memory for Multi-Task Dense Prediction28 Aug 2026
- 2026Unified Video Dense Prediction from Disjoint Data23 Jul 2026
- 2026Low-cost concept-based localized explanations: How far can we get with training-free approaches?27 Jun 2026
- 2026Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Parts19 Jun 2026
- 2026GLARE: A Natural Language Interface for Querying Global Explanations18 Jun 2026
- 2026Unsupervised Semantic Segmentation Facilitates Model Understanding28 May 2026
- 2026Category-Level 3D Correspondence in Camera Space via Morphable Object Priors27 May 2026
- 2026COCOTree: A Dataset and Benchmark for Open Tree-Structured Visual Decomposition21 May 2026
- 2026SceneParser: Hierarchical Scene Parsing for Visual Semantics Understanding14 May 2026
- 2026AnchorSeg: Language Grounded Query Banks for Reasoning Segmentation20 Apr 2026
- 2026PR-MaGIC: Prompt Refinement Via Mask Decoder Gradient Flow For In-Context Segmentation13 Apr 2026
- 2026Online Reasoning Video Object Segmentation13 Apr 2026
12 newest of 178 All 178 (JSON)