FineGAN: Unsupervised Hierarchical Disentanglement for Fine-Grained Object Generation and Discovery
Not on the map. Why?
Abstract (arXiv)
We propose FineGAN, a novel unsupervised GAN framework, which disentangles the background, object shape, and object appearance to hierarchically generate images of fine-grained object categories. To disentangle the factors without supervision, our key idea is to use information theory to associate each factor to a latent code, and to condition the relationships between the codes in a specific way to induce the desired hierarchy. Through extensive experiments, we show that FineGAN achieves the desired disentanglement to generate realistic and diverse images belonging to fine-grained classes of birds, dogs, and cars. Using FineGAN's automatically learned features, we also cluster real images as a first attempt at solving the novel problem of unsupervised fine-grained object category discovery. Our code/models/demo can be found at https://github.com/kkanshul/finegan
Key facts. Cited by 58 papers in the map (data through 13 Oct 2026). First posted on arXiv 27 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 11; 2023: 11; 2024: 5; 2025: 5; 2026: 2.
58 papers.
Sort:
By area:
- 2021Projected GANs Converge Fastercited by 207
- 2022Disentangled Representation Learningcited by 112
- 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
- 2021Defect-GAN: High-Fidelity Defect Synthesis for Automated Defect Inspectioncited by 77
- 2021Unsupervised Layered Image Decomposition into Object Prototypescited by 50
- 2021Learning Generative Models of Textured 3D Meshes from Real-World Imagescited by 44
- 2021Diagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translationcited by 35
- 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketchescited by 34
- 2023The Hidden Language of Diffusion Modelscited by 34
- 2021CoMoGAN: continuous model-guided image-to-image translationcited by 27
- 2021Where and What? Examining Interpretable Disentangled Representationscited by 27
- 2021Unsupervised Foreground Extraction via Deep Region Competitioncited by 26
38 more
- 2021Collaging Class-specific GANs for Semantic Image Synthesiscited by 25
- 2022Is an Object-Centric Video Representation Beneficial for Transfer?cited by 24
- 2021GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generationcited by 19
- 2022CoordGAN: Self-Supervised Dense Correspondences Emerge from GANscited by 17
- 2023MOST: Multiple Object localization with Self-supervised Transformers for object discoverycited by 17
- 2021The Pursuit of Knowledge: Discovering and Localizing Novel Categories using Dual Memorycited by 13
- 2021Benchmarks, Algorithms, and Metrics for Hierarchical Disentanglementcited by 12
- 2024Compositional Image Decomposition with Diffusion Modelscited by 12
- 2021Style Equalization: Unsupervised Learning of Controllable Generative Sequence Modelscited by 11
- 2023SIEDOB: Semantic Image Editing by Disentangling Object and Backgroundcited by 11
- 2021MOGAN: Morphologic-structure-aware Generative Learning from a Single Imagecited by 9
- 2021Physics-informed Guided Disentanglement in Generative Networkscited by 9
- 2021Contrastive Fine-grained Class Clustering via Generative Adversarial Networkscited by 9
- 2023TUVF: Learning Generalizable Texture UV Radiance Fieldscited by 9
- 2024Graph-based Unsupervised Disentangled Representation Learning via Multimodal Large Language Modelscited by 9
- 2025Hadamard product in deep learning: Introduction, Advances and Challengescited by 9
- 2021Learning Foreground-Background Segmentation from Improved Layered GANscited by 7
- 2021Knowledge-Guided Object Discovery with Acquired Deep Impressionscited by 6
- 2021DisUnknown: Distilling Unknown Factors for Disentanglement Learningcited by 6
- 2022FurryGAN: High Quality Foreground-aware Image Synthesiscited by 6
- 2022Extracting Semantic Knowledge from GANs with Unsupervised Learningcited by 5
- 2022NeRFEditor: Differentiable Style Decomposition for Full 3D Scene Editingcited by 5
- 2022Foreground-Background Separation through Concept Distillation from Generative Image Foundation Modelscited by 5
- 2023Controllable Image Generation via Collage Representationscited by 5
- 2021Generative Adversarial Networks and Adversarial Autoencoders: Tutorial and Surveycited by 4
- 2022Contrastive Learning for Diverse Disentangled Foreground Generationcited by 4
- 2024Disentangling Disentangled Representations: Towards Improved Latent Units via Diffusion Modelscited by 4
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomycited by 4
- 2021Generating Furry Cars: Disentangling Object Shape & Appearance across Multiple Domainscited by 3
- 2021Cluster-guided Image Synthesis with Unconditional Modelscited by 3
- 2023ToddlerDiffusion: Interactive Structured Image Generation with Cascaded Schr"odinger Bridgecited by 3
- 2021Equine Pain Behavior Classification via Self-Supervised Disentangled Pose Representationcited by 2
- 2022ILSGAN: Independent Layer Synthesis for Unsupervised Foreground-Background Segmentationcited by 2
- 2023Multi-object Video Generation from Single Frame Layoutscited by 2
- 2022Unsupervised Structure-Consistent Image-to-Image Translationcited by 1
- 2023SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentationcited by 1
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generationcited by 1
- 2025Post-Hoc Concept Disentanglement: From Correlated to Isolated Concept Representationscited by 1
50 most cited of 58 All 58 (JSON)
- 2026Universal Guideline-Driven Image Clustering via a Hybrid LLM Agent23 Jun 2026
- 2026Enhancing Visual In-Context Learning by Multi-Faceted Fusion15 Jan 2026
- 2025DeMoGen: Towards Decompositional Human Motion Generation with Energy-Based Diffusion Models26 Dec 2025
- 2025Weakly Supervised Object Segmentation by Background Conditional Divergence25 Jun 2025
- 2025Hadamard product in deep learning: Introduction, Advances and Challenges17 Apr 2025
- 2025Post-Hoc Concept Disentanglement: From Correlated to Isolated Concept Representations7 Mar 2025
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generation7 Jan 2025
- 2024Disentangling Disentangled Representations: Towards Improved Latent Units via Diffusion Models31 Oct 2024
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomy30 Oct 2024
- 2024Task-Decoupled Image Inpainting Framework for Class-specific Object Remover3 Oct 2024
- 2024Graph-based Unsupervised Disentangled Representation Learning via Multimodal Large Language Models26 Jul 2024
- 2024Compositional Image Decomposition with Diffusion Models27 Jun 2024
38 more
- 2023ToddlerDiffusion: Interactive Structured Image Generation with Cascaded Schr"odinger Bridge24 Nov 2023
- 2023Disentangled Latent Spaces Facilitate Data-Driven Auxiliary Learning13 Oct 2023
- 2023Compositional Representation Learning for Brain Tumour Segmentation10 Oct 2023
- 2023The Hidden Language of Diffusion Models1 Jun 2023
- 2023Multi-object Video Generation from Single Frame Layouts6 May 2023
- 2023TUVF: Learning Generalizable Texture UV Radiance Fields4 May 2023
- 2023Controllable Image Generation via Collage Representations26 Apr 2023
- 2023MOST: Multiple Object localization with Self-supervised Transformers for object discovery11 Apr 2023
- 2023SIEDOB: Semantic Image Editing by Disentangling Object and Background23 Mar 2023
- 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketches20 Mar 2023
- 2023SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation1 Jan 2023
- 2022Foreground-Background Separation through Concept Distillation from Generative Image Foundation Models29 Dec 2022
- 2022NeRFEditor: Differentiable Style Decomposition for Full 3D Scene Editing7 Dec 2022
- 2022Extracting Semantic Knowledge from GANs with Unsupervised Learning30 Nov 2022
- 2022ILSGAN: Independent Layer Synthesis for Unsupervised Foreground-Background Segmentation25 Nov 2022
- 2022Disentangled Representation Learning21 Nov 2022
- 2022Contrastive Learning for Diverse Disentangled Foreground Generation4 Nov 2022
- 2022Unsupervised Structure-Consistent Image-to-Image Translation24 Aug 2022
- 2022FurryGAN: High Quality Foreground-aware Image Synthesis22 Aug 2022
- 2022Is an Object-Centric Video Representation Beneficial for Transfer?20 Jul 2022
- 2022CoordGAN: Self-Supervised Dense Correspondences Emerge from GANs30 Mar 2022
- 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Model28 Mar 2022
- 2021Contrastive Fine-grained Class Clustering via Generative Adversarial Networks30 Dec 2021
- 2021Cluster-guided Image Synthesis with Unconditional Models24 Dec 2021
- 2021GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generation2 Dec 2021
- 2021Generative Adversarial Networks and Adversarial Autoencoders: Tutorial and Survey26 Nov 2021
- 2021Projected GANs Converge Faster1 Nov 2021
- 2021Unsupervised Foreground Extraction via Deep Region Competition29 Oct 2021
- 2021Collaging Class-specific GANs for Semantic Image Synthesis8 Oct 2021
- 2021Style Equalization: Unsupervised Learning of Controllable Generative Sequence Models6 Oct 2021
- 2021DisUnknown: Distilling Unknown Factors for Disentanglement Learning16 Sep 2021
- 2021Equine Pain Behavior Classification via Self-Supervised Disentangled Pose Representation30 Aug 2021
- 2021Physics-informed Guided Disentanglement in Generative Networks29 Jul 2021
- 2021The Pursuit of Knowledge: Discovering and Localizing Novel Categories using Dual Memory4 May 2021
- 2021Unsupervised Layered Image Decomposition into Object Prototypes29 Apr 2021
- 2021Where and What? Examining Interpretable Disentangled Representations7 Apr 2021
- 2021Generating Furry Cars: Disentangling Object Shape & Appearance across Multiple Domains5 Apr 2021
- 2021Learning Foreground-Background Segmentation from Improved Layered GANs1 Apr 2021
50 newest of 58 All 58 (JSON)
- 2023The Hidden Language of Diffusion Modelscited by 34
- 2024Compositional Image Decomposition with Diffusion Modelscited by 12
- 2022Foreground-Background Separation through Concept Distillation from Generative Image Foundation Modelscited by 5
- 2024Disentangling Disentangled Representations: Towards Improved Latent Units via Diffusion Modelscited by 4
- 2023ToddlerDiffusion: Interactive Structured Image Generation with Cascaded Schr"odinger Bridgecited by 3
- 2025DeMoGen: Towards Decompositional Human Motion Generation with Energy-Based Diffusion Modelscited by 0
- 2025DeMoGen: Towards Decompositional Human Motion Generation with Energy-Based Diffusion Models26 Dec 2025
- 2024Disentangling Disentangled Representations: Towards Improved Latent Units via Diffusion Models31 Oct 2024
- 2024Compositional Image Decomposition with Diffusion Models27 Jun 2024
- 2023ToddlerDiffusion: Interactive Structured Image Generation with Cascaded Schr"odinger Bridge24 Nov 2023
- 2023The Hidden Language of Diffusion Models1 Jun 2023
- 2022Foreground-Background Separation through Concept Distillation from Generative Image Foundation Models29 Dec 2022
- 2021Projected GANs Converge Fastercited by 207
- 2022Disentangled Representation Learningcited by 112
- 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
- 2021Defect-GAN: High-Fidelity Defect Synthesis for Automated Defect Inspectioncited by 77
- 2021Unsupervised Layered Image Decomposition into Object Prototypescited by 50
- 2021Learning Generative Models of Textured 3D Meshes from Real-World Imagescited by 44
- 2021Diagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translationcited by 35
- 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketchescited by 34
- 2021CoMoGAN: continuous model-guided image-to-image translationcited by 27
- 2021Where and What? Examining Interpretable Disentangled Representationscited by 27
- 2021Collaging Class-specific GANs for Semantic Image Synthesiscited by 25
- 2022Is an Object-Centric Video Representation Beneficial for Transfer?cited by 24
12 most cited of 49 All 49 (JSON)
- 2026Universal Guideline-Driven Image Clustering via a Hybrid LLM Agent23 Jun 2026
- 2026Enhancing Visual In-Context Learning by Multi-Faceted Fusion15 Jan 2026
- 2025Weakly Supervised Object Segmentation by Background Conditional Divergence25 Jun 2025
- 2025Hadamard product in deep learning: Introduction, Advances and Challenges17 Apr 2025
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generation7 Jan 2025
- 2024Unsupervised Object Discovery: A Comprehensive Survey and Unified Taxonomy30 Oct 2024
- 2024Task-Decoupled Image Inpainting Framework for Class-specific Object Remover3 Oct 2024
- 2023Disentangled Latent Spaces Facilitate Data-Driven Auxiliary Learning13 Oct 2023
- 2023Compositional Representation Learning for Brain Tumour Segmentation10 Oct 2023
- 2023Multi-object Video Generation from Single Frame Layouts6 May 2023
- 2023TUVF: Learning Generalizable Texture UV Radiance Fields4 May 2023
- 2023Controllable Image Generation via Collage Representations26 Apr 2023
12 newest of 49 All 49 (JSON)