Semantic Jitter: Dense Supervision for Visual Comparisons via Synthetic Images
Not on the map. Why?
Abstract (arXiv)
Distinguishing subtle differences in attributes is valuable, yet learning to make visual comparisons remains non-trivial. Not only is the number of possible comparisons quadratic in the number of training images, but also access to images adequately spanning the space of fine-grained visual differences is limited. We propose to overcome the sparsity of supervision problem via synthetically generated images. Building on a state-of-the-art image generation engine, we sample pairs of training images exhibiting slight modifications of individual attributes. Augmenting real training image pairs with these examples, we then train attribute ranking models to predict the relative strength of an attribute in novel pairs of real images. Our results on datasets of faces and fashion images show the great promise of bootstrapping imperfect image generators to counteract sample sparsity for learning to rank.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Dec 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 13; 2022: 14; 2023: 9; 2024: 3; 2025: 4; 2026: 1.
45 papers.
Sort:
By area:
- 2021GAN Inversion: A Surveycited by 366
- 2021Learning Graph Embeddings for Compositional Zero-shot Learningcited by 112
- 2021Open World Compositional Zero-Shot Learningcited by 100
- 2021Learning Graph Embeddings for Open World Compositional Zero-Shot Learningcited by 49
- 2022KG-SP: Knowledge Guided Simple Primitives for Open World Compositional Zero-Shot Learningcited by 41
- 2022Proactive Image Manipulation Detectioncited by 35
- 2023Learning Conditional Attributes for Compositional Zero-Shot Learningcited by 28
- 2022FHIST: A Benchmark for Few-shot Classification of Histological Imagescited by 20
- 2022Learning Attention Propagation for Compositional Zero-Shot Learningcited by 20
- 2021Free-form tumor synthesis in computed tomography images via richer generative adversarial networkcited by 16
- 2021Zero-Shot Compositional Concept Learningcited by 16
- 2024A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practicescited by 15
33 more
- 2022On Leveraging Variational Graph Embeddings for Open World Compositional Zero-Shot Learningcited by 13
- 2023Distilled Reverse Attention Network for Open-world Compositional Zero-Shot Learningcited by 11
- 2021Deep Image Synthesis from Intuitive User Input: A Review and Perspectivescited by 8
- 2021Learning Single/Multi-Attribute of Object with Symmetry and Groupcited by 8
- 2023CAILA: Concept-Aware Intra-Layer Adapters for Compositional Zero-Shot Learningcited by 7
- 2025A Survey on Large Language Models in Multimodal Recommender Systemscited by 7
- 2021Contextualizing Meta-Learning via Learning to Decomposecited by 5
- 2022Training and challenging models for text-guided fashion image retrievalcited by 5
- 2021Smart Fashion: A Review of AI Applications in the Fashion & Apparel Industrycited by 4
- 2021Lifelong Generative Modelling Using Dynamic Expansion Graph Modelcited by 4
- 2022Identifying Ambiguous Similarity Conditions via Semantic Matchingcited by 4
- 2018Give me a hint! Navigating Image Databases using Human-in-the-loop Feedbackcited by 3
- 2022LOCL: Learning Object-Attribute Composition using Localizationcited by 3
- 2022Mutual Balancing in State-Object Components for Compositional Zero-Shot Learningcited by 3
- 2022Multi-Attribute Open Set Recognitioncited by 2
- 2022Deception for Cyber Defence: Challenges and Opportunitiescited by 2
- 2023Multi-Similarity Contrastive Learningcited by 2
- 2021Directly Training Joint Energy-Based Models for Conditional Synthesis and Calibrated Prediction of Multi-Attribute Datacited by 1
- 2022Variational Transfer Learning using Cross-Domain Latent Modulationcited by 1
- 2022Instance-level Heterogeneous Domain Adaptation for Limited-labeled Sketch-to-Photo Retrievalcited by 1
- 2023An Extensible Multimodal Multi-task Object Dataset with Materialscited by 1
- 2023Recognizing Unseen States of Unknown Objects by Leveraging Knowledge Graphscited by 1
- 2023Unsupervised Landmark Discovery Using Consistency Guided Bottleneckcited by 1
- 2024Compositional Zero-Shot Learning with Contextualized Cues and Adaptive Contrastive Trainingcited by 1
- 2021Domain Adaptation for Learning Generator from Paired Few-Shot Datacited by 0
- 2022Simple Primitives with Feasibility- and Contextuality-Dependence for Open-World Compositional Zero-shot Learningcited by 0
- 2023Fashionpedia-Taste: A Dataset towards Explaining Human Fashion Tastecited by 0
- 2023Fashionpedia-Ads: Do Your Favorite Advertisements Reveal Your Fashion Taste?cited by 0
- 2024Attention Based Simple Primitives for Open World Compositional Zero-Shot Learningcited by 0
- 2025Feasibility with Language Models for Open-World Compositional Zero-Shot Learningcited by 0
- 2025Generative Adversarial Networks Applied for Privacy Preservation in Biometric-Based Authentication and Identificationcited by 0
- 2025Embedding the Teacher: Distilling vLLM Preferences for Scalable Image Retrievalcited by 0
- 2026Stitching and dimensionality effects on large artificially generated volume datasetscited by 0
- 2026Stitching and dimensionality effects on large artificially generated volume datasets18 Jun 2026
- 2025Embedding the Teacher: Distilling vLLM Preferences for Scalable Image Retrieval13 Oct 2025
- 2025Generative Adversarial Networks Applied for Privacy Preservation in Biometric-Based Authentication and Identification24 Sep 2025
- 2025Feasibility with Language Models for Open-World Compositional Zero-Shot Learning16 May 2025
- 2025A Survey on Large Language Models in Multimodal Recommender Systems14 May 2025
- 2024Compositional Zero-Shot Learning with Contextualized Cues and Adaptive Contrastive Training10 Dec 2024
- 2024Attention Based Simple Primitives for Open World Compositional Zero-Shot Learning18 Jul 2024
- 2024A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practices13 Jun 2024
- 2023Unsupervised Landmark Discovery Using Consistency Guided Bottleneck19 Sep 2023
- 2023Recognizing Unseen States of Unknown Objects by Leveraging Knowledge Graphs22 Jul 2023
- 2023Multi-Similarity Contrastive Learning6 Jul 2023
- 2023Learning Conditional Attributes for Compositional Zero-Shot Learning29 May 2023
33 more
- 2023CAILA: Concept-Aware Intra-Layer Adapters for Compositional Zero-Shot Learning26 May 2023
- 2023Fashionpedia-Ads: Do Your Favorite Advertisements Reveal Your Fashion Taste?3 May 2023
- 2023Fashionpedia-Taste: A Dataset towards Explaining Human Fashion Taste3 May 2023
- 2023An Extensible Multimodal Multi-task Object Dataset with Materials29 Apr 2023
- 2023Distilled Reverse Attention Network for Open-world Compositional Zero-Shot Learning1 Mar 2023
- 2022Instance-level Heterogeneous Domain Adaptation for Limited-labeled Sketch-to-Photo Retrieval26 Nov 2022
- 2022Mutual Balancing in State-Object Components for Compositional Zero-Shot Learning19 Nov 2022
- 2022Simple Primitives with Feasibility- and Contextuality-Dependence for Open-World Compositional Zero-shot Learning5 Nov 2022
- 2022Learning Attention Propagation for Compositional Zero-Shot Learning20 Oct 2022
- 2022LOCL: Learning Object-Attribute Composition using Localization7 Oct 2022
- 2022Deception for Cyber Defence: Challenges and Opportunities15 Aug 2022
- 2022Multi-Attribute Open Set Recognition14 Aug 2022
- 2022FHIST: A Benchmark for Few-shot Classification of Histological Images31 May 2022
- 2022Variational Transfer Learning using Cross-Domain Latent Modulation31 May 2022
- 2022KG-SP: Knowledge Guided Simple Primitives for Open World Compositional Zero-Shot Learning13 May 2022
- 2022On Leveraging Variational Graph Embeddings for Open World Compositional Zero-Shot Learning23 Apr 2022
- 2022Training and challenging models for text-guided fashion image retrieval23 Apr 2022
- 2022Identifying Ambiguous Similarity Conditions via Semantic Matching8 Apr 2022
- 2022Proactive Image Manipulation Detection29 Mar 2022
- 2021Lifelong Generative Modelling Using Dynamic Expansion Graph Model15 Dec 2021
- 2021Smart Fashion: A Review of AI Applications in the Fashion & Apparel Industry28 Oct 2021
- 2021Learning Single/Multi-Attribute of Object with Symmetry and Group9 Oct 2021
- 2021Directly Training Joint Energy-Based Models for Conditional Synthesis and Calibrated Prediction of Multi-Attribute Data19 Jul 2021
- 2021Zero-Shot Compositional Concept Learning12 Jul 2021
- 2021Deep Image Synthesis from Intuitive User Input: A Review and Perspectives9 Jul 2021
- 2021Contextualizing Meta-Learning via Learning to Decompose15 Jun 2021
- 2021Learning Graph Embeddings for Open World Compositional Zero-Shot Learning3 May 2021
- 2021Free-form tumor synthesis in computed tomography images via richer generative adversarial network20 Apr 2021
- 2021Domain Adaptation for Learning Generator from Paired Few-Shot Data25 Feb 2021
- 2021Learning Graph Embeddings for Compositional Zero-shot Learning3 Feb 2021
- 2021Open World Compositional Zero-Shot Learning29 Jan 2021
- 2021GAN Inversion: A Survey14 Jan 2021
- 2018Give me a hint! Navigating Image Databases using Human-in-the-loop Feedback24 Sep 2018
- 2021GAN Inversion: A Surveycited by 366
- 2021Learning Graph Embeddings for Compositional Zero-shot Learningcited by 112
- 2021Open World Compositional Zero-Shot Learningcited by 100
- 2021Learning Graph Embeddings for Open World Compositional Zero-Shot Learningcited by 49
- 2022KG-SP: Knowledge Guided Simple Primitives for Open World Compositional Zero-Shot Learningcited by 41
- 2022Proactive Image Manipulation Detectioncited by 35
- 2023Learning Conditional Attributes for Compositional Zero-Shot Learningcited by 28
- 2022FHIST: A Benchmark for Few-shot Classification of Histological Imagescited by 20
- 2022Learning Attention Propagation for Compositional Zero-Shot Learningcited by 20
- 2021Free-form tumor synthesis in computed tomography images via richer generative adversarial networkcited by 16
- 2021Zero-Shot Compositional Concept Learningcited by 16
- 2024A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practicescited by 15
12 most cited of 43 All 43 (JSON)
- 2026Stitching and dimensionality effects on large artificially generated volume datasets18 Jun 2026
- 2025Generative Adversarial Networks Applied for Privacy Preservation in Biometric-Based Authentication and Identification24 Sep 2025
- 2025Feasibility with Language Models for Open-World Compositional Zero-Shot Learning16 May 2025
- 2025A Survey on Large Language Models in Multimodal Recommender Systems14 May 2025
- 2024Compositional Zero-Shot Learning with Contextualized Cues and Adaptive Contrastive Training10 Dec 2024
- 2024Attention Based Simple Primitives for Open World Compositional Zero-Shot Learning18 Jul 2024
- 2024A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practices13 Jun 2024
- 2023Unsupervised Landmark Discovery Using Consistency Guided Bottleneck19 Sep 2023
- 2023Recognizing Unseen States of Unknown Objects by Leveraging Knowledge Graphs22 Jul 2023
- 2023Multi-Similarity Contrastive Learning6 Jul 2023
- 2023Learning Conditional Attributes for Compositional Zero-Shot Learning29 May 2023
- 2023CAILA: Concept-Aware Intra-Layer Adapters for Compositional Zero-Shot Learning26 May 2023
12 newest of 43 All 43 (JSON)