Deep Feature Factorization For Concept Discovery
Not on the map. Why?
Abstract (arXiv)
We propose Deep Feature Factorization (DFF), a method capable of localizing similar semantic concepts within an image or a set of images. We use DFF to gain insight into a deep convolutional neural network's learned features, where we detect hierarchical cluster structures in feature space. This is visualized as heat maps, which highlight semantically matching regions across a set of images, revealing what the network `perceives' as similar. DFF can also be used to perform co-segmentation and co-localization, and we report state-of-the-art results on these tasks.
Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 14; 2023: 12; 2024: 16; 2025: 8; 2026: 3.
64 papers.
Sort:
By area:
- 2021GAN Inversion: A Surveycited by 366
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2022Unsupervised Semantic Segmentation by Distilling Feature Correspondencescited by 241
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2022ReCo: Retrieve and Co-segment for Zero-shot Transfercited by 115
- 2021PartImageNet: A Large, High-Quality Dataset of Partscited by 107
- 2022LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discoverycited by 65
- 2021Unsupervised Part Discovery from Contrastive Reconstructioncited by 57
- 2021Self-supervised Multi-view Stereo via Effective Co-Segmentation and Data-Augmentationcited by 31
- 2022Hi-LASSIE: High-Fidelity Articulated Shape and Skeleton Discovery from Sparse Image Ensemblecited by 30
- 2021Unsupervised Part Segmentation through Disentangling Appearance and Shapecited by 29
- 2023Self Correspondence Distillation for End-to-End Weakly-Supervised Semantic Segmentationcited by 26
38 more
- 2021Linear Semantics in Generative Adversarial Networkscited by 25
- 2022DeepCut: Unsupervised Segmentation using Graph Neural Networks Clusteringcited by 25
- 2023PDiscoNet: Semantically consistent part discovery for fine-grained recognitioncited by 21
- 2022PandA: Unsupervised Learning of Parts and Appearances in the Feature Maps of GANscited by 20
- 2021GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generationcited by 19
- 2022AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypointscited by 17
- 2022Neural Networks are Decision Treescited by 16
- 2023Unsupervised Keypoints from Pretrained Diffusion Modelscited by 15
- 2021Unsupervised Co-part Segmentation through Assemblycited by 12
- 2024Interpreting and Analysing CLIP's Zero-Shot Image Classification via Mutual Knowledgecited by 12
- 2022Training and Tuning Generative Neural Radiance Fields for Attribute-Conditional 3D-Aware Face Generationcited by 8
- 2024Benchmarking XAI Explanations with Human-Aligned Evaluationscited by 8
- 2022HP-Capsule: Unsupervised Face Part Discovery by Hierarchical Parsing Capsule Networkcited by 7
- 2023Uncovering the Inner Workings of STEGO for Safe Unsupervised Semantic Segmentationcited by 7
- 2023Optical Flow boosts Unsupervised Localization and Segmentationcited by 7
- 2024Post-hoc Part-prototype Networkscited by 7
- 2023Unsupervised Discovery of 3D Hierarchical Structure with Generative Diffusion Featurescited by 4
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomycited by 4
- 2024CALICO: Part-Focused Semantic Co-Segmentation with Large Vision-Language Modelscited by 4
- 2023Graphics Capsule: Learning Hierarchical 3D Face Representations from 2D Imagescited by 3
- 2024Masked Multi-Query Slot Attention for Unsupervised Object Discoverycited by 3
- 2024Segmentation by Factorization: Unsupervised Semantic Segmentation for Pathology by Factorizing Foundation Model Featurescited by 3
- 2021Stochastic Block-ADMM for Training Deep Networkscited by 2
- 2021Self-Supervised Object Detection via Generative Image Synthesiscited by 2
- 2022LEAD: Self-Supervised Landmark Estimation by Aligning Distributions of Feature Similaritycited by 2
- 2022Automatic Infectious Disease Classification Analysis with Concept Discoverycited by 2
- 2023Interpreting Vision and Language Generative Models with Semantic Visual Priorscited by 2
- 2024FFAM: Feature Factorization Activation Map for Explanation of 3D Detectorscited by 2
- 2024Composing Parts for Expressive Object Generationcited by 2
- 2024Unsupervised Part Discovery via Dual Representation Alignmentcited by 2
- 2023Bridging Neural and Symbolic Representations with Transitional Dictionary Learningcited by 1
- 2023FM-G-CAM: A Holistic Approach for Explainable AI in Computer Visioncited by 1
- 2024Geometric Constraints in Deep Learning Frameworks: A Surveycited by 1
- 2024Towards Robust Ferrous Scrap Material Classification with Deep Learning and Conformal Predictioncited by 1
- 2024TACO: Training-free Sound Prompted Segmentation via Semantically Constrained Audio-visual CO-factorizationcited by 1
- 2025Bottom-Up Scattering Information Perception Network for SAR target recognitioncited by 1
- 2025Occlusion-Aware Self-Supervised Monocular Depth Estimation for Weak-Texture Endoscopic Imagescited by 1
- 2025Explainable Artificial Intelligence in Biomedical Image Analysis: A Comprehensive Surveycited by 1
50 most cited of 64 All 64 (JSON)
- 2026When Do Concepts Become Functionally Sufficient During Language-Model Training?15 Aug 2026
- 2026Don't Forget Your Embeddings: Robust Knowledge Erasure via Precise Editing of Embeddings2 Jun 2026
- 2026What-Where Transformer: A Slot-Centric Visual Backbone for Concurrent Representation and Localization12 May 2026
- 2025Explaining Digital Pathology Models via Clustering Activations18 Nov 2025
- 2025FaCT: Faithful Concept Traces for Explaining Neural Network Decisions29 Oct 2025
- 2025Unsupervised Part Discovery via Descriptor-Based Masked Image Restoration with Optimized Constraints16 Jul 2025
- 2025Conceptualizing Multi-scale Wavelet Attention and Ray-based Encoding for Human-Object Interaction Detection15 Jul 2025
- 2025Explainable Artificial Intelligence in Biomedical Image Analysis: A Comprehensive Survey9 Jul 2025
- 2025Canonical Latent Representations in Conditional Diffusion Models11 Jun 2025
- 2025Occlusion-Aware Self-Supervised Monocular Depth Estimation for Weak-Texture Endoscopic Images24 Apr 2025
- 2025Bottom-Up Scattering Information Perception Network for SAR target recognition7 Apr 2025
- 2024CALICO: Part-Focused Semantic Co-Segmentation with Large Vision-Language Models26 Dec 2024
38 more
- 2024Spoof Trace Discovery for Deep Learning Based Explainable Face Anti-Spoofing23 Dec 2024
- 2024TACO: Training-free Sound Prompted Segmentation via Semantically Constrained Audio-visual CO-factorization2 Dec 2024
- 2024Benchmarking XAI Explanations with Human-Aligned Evaluations4 Nov 2024
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomy30 Oct 2024
- 2024Interpreting and Analysing CLIP's Zero-Shot Image Classification via Mutual Knowledge16 Oct 2024
- 2024Depth-Guided Self-Supervised Human Keypoint Detection via Cross-Modal Distillation4 Oct 2024
- 2024Seg-HGNN: Unsupervised and Light-Weight Image Segmentation with Hyperbolic Graph Neural Networks10 Sep 2024
- 2024Segmentation by Factorization: Unsupervised Semantic Segmentation for Pathology by Factorizing Foundation Model Features9 Sep 2024
- 2024Unsupervised Part Discovery via Dual Representation Alignment15 Aug 2024
- 2024Composing Parts for Expressive Object Generation14 Jun 2024
- 2024Post-hoc Part-prototype Networks5 Jun 2024
- 2024FFAM: Feature Factorization Activation Map for Explanation of 3D Detectors21 May 2024
- 2024Masked Multi-Query Slot Attention for Unsupervised Object Discovery30 Apr 2024
- 2024Towards Robust Ferrous Scrap Material Classification with Deep Learning and Conformal Prediction19 Apr 2024
- 2024Geometric Constraints in Deep Learning Frameworks: A Survey19 Mar 2024
- 2023FM-G-CAM: A Holistic Approach for Explainable AI in Computer Vision10 Dec 2023
- 2023Unsupervised Keypoints from Pretrained Diffusion Models29 Nov 2023
- 2023PDiscoNet: Semantically consistent part discovery for fine-grained recognition6 Sep 2023
- 2023TExplain: Explaining Learned Visual Features via Pre-trained (Frozen) Language Models1 Sep 2023
- 2023Bridging Neural and Symbolic Representations with Transitional Dictionary Learning3 Aug 2023
- 2023Optical Flow boosts Unsupervised Localization and Segmentation25 Jul 2023
- 2023Unsupervised Discovery of 3D Hierarchical Structure with Generative Diffusion Features28 Apr 2023
- 2023Interpreting Vision and Language Generative Models with Semantic Visual Priors28 Apr 2023
- 2023Uncovering the Inner Workings of STEGO for Safe Unsupervised Semantic Segmentation14 Apr 2023
- 2023LEURN: Learning Explainable Univariate Rules with Neural Networks27 Mar 2023
- 2023Graphics Capsule: Learning Hierarchical 3D Face Representations from 2D Images20 Mar 2023
- 2023Self Correspondence Distillation for End-to-End Weakly-Supervised Semantic Segmentation27 Feb 2023
- 2022Hi-LASSIE: High-Fidelity Articulated Shape and Skeleton Discovery from Sparse Image Ensemble21 Dec 2022
- 2022DeepCut: Unsupervised Segmentation using Graph Neural Networks Clustering12 Dec 2022
- 2022Neural Networks are Decision Trees11 Oct 2022
- 2022Automatic Infectious Disease Classification Analysis with Concept Discovery28 Aug 2022
- 2022Training and Tuning Generative Neural Radiance Fields for Attribute-Conditional 3D-Aware Face Generation26 Aug 2022
- 2022LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discovery7 Jul 2022
- 2022ReCo: Retrieve and Co-segment for Zero-shot Transfer14 Jun 2022
- 2022APES: Articulated Part Extraction from Sprite Sheets4 Jun 2022
- 2022PandA: Unsupervised Learning of Parts and Appearances in the Feature Maps of GANs31 May 2022
- 2022AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypoints21 May 2022
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization16 May 2022
50 newest of 64 All 64 (JSON)
- 2023Unsupervised Keypoints from Pretrained Diffusion Modelscited by 15
- 2023Unsupervised Discovery of 3D Hierarchical Structure with Generative Diffusion Featurescited by 4
- 2024Composing Parts for Expressive Object Generationcited by 2
- 2025Canonical Latent Representations in Conditional Diffusion Modelscited by 0
- 2025Canonical Latent Representations in Conditional Diffusion Models11 Jun 2025
- 2024Composing Parts for Expressive Object Generation14 Jun 2024
- 2023Unsupervised Keypoints from Pretrained Diffusion Models29 Nov 2023
- 2023Unsupervised Discovery of 3D Hierarchical Structure with Generative Diffusion Features28 Apr 2023
- 2021GAN Inversion: A Surveycited by 366
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2022Unsupervised Semantic Segmentation by Distilling Feature Correspondencescited by 241
- 2022Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localizationcited by 150
- 2022ReCo: Retrieve and Co-segment for Zero-shot Transfercited by 115
- 2021PartImageNet: A Large, High-Quality Dataset of Partscited by 107
- 2022LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discoverycited by 65
- 2021Unsupervised Part Discovery from Contrastive Reconstructioncited by 57
- 2021Self-supervised Multi-view Stereo via Effective Co-Segmentation and Data-Augmentationcited by 31
- 2022Hi-LASSIE: High-Fidelity Articulated Shape and Skeleton Discovery from Sparse Image Ensemblecited by 30
- 2021Unsupervised Part Segmentation through Disentangling Appearance and Shapecited by 29
- 2023Self Correspondence Distillation for End-to-End Weakly-Supervised Semantic Segmentationcited by 26
12 most cited of 58 All 58 (JSON)
- 2026When Do Concepts Become Functionally Sufficient During Language-Model Training?15 Aug 2026
- 2026Don't Forget Your Embeddings: Robust Knowledge Erasure via Precise Editing of Embeddings2 Jun 2026
- 2026What-Where Transformer: A Slot-Centric Visual Backbone for Concurrent Representation and Localization12 May 2026
- 2025Explaining Digital Pathology Models via Clustering Activations18 Nov 2025
- 2025FaCT: Faithful Concept Traces for Explaining Neural Network Decisions29 Oct 2025
- 2025Unsupervised Part Discovery via Descriptor-Based Masked Image Restoration with Optimized Constraints16 Jul 2025
- 2025Conceptualizing Multi-scale Wavelet Attention and Ray-based Encoding for Human-Object Interaction Detection15 Jul 2025
- 2025Explainable Artificial Intelligence in Biomedical Image Analysis: A Comprehensive Survey9 Jul 2025
- 2025Occlusion-Aware Self-Supervised Monocular Depth Estimation for Weak-Texture Endoscopic Images24 Apr 2025
- 2025Bottom-Up Scattering Information Perception Network for SAR target recognition7 Apr 2025
- 2024Spoof Trace Discovery for Deep Learning Based Explainable Face Anti-Spoofing23 Dec 2024
- 2024TACO: Training-free Sound Prompted Segmentation via Semantically Constrained Audio-visual CO-factorization2 Dec 2024
12 newest of 58 All 58 (JSON)