mlsanityData to 14 Oct 2026

QUOTA: Quantifying Objects with Text-to-Image Models for Any Domain

arXiv 2411.19534 ↗First posted 29 Nov 2024cs.CV cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

We tackle the problem of quantifying the number of objects by a generative text-to-image model. Rather than retraining such a model for each new image domain of interest, which leads to high computational costs and limited scalability, we are the first to consider this problem from a domain-agnostic perspective. We propose QUOTA, an optimization framework for text-to-image models that enables effective object quantification across unseen domains without retraining. It leverages a dual-loop meta-learning strategy to optimize a domain-invariant prompt. Further, by integrating prompt learning with learnable counting and domain tokens, our method captures stylistic variations and maintains accuracy, even for object classes not encountered during training. For evaluation, we adopt a new benchmark specifically designed for object quantification in domain generalization, enabling rigorous assessment of object quantification accuracy and adaptability across unseen domains in text-to-image generation. Extensive experiments demonstrate that QUOTA outperforms conventional models in both object quantification accuracy and semantic consistency, setting a new benchmark for efficient and scalable text-to-image generation for any domain.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 29 of its 37 references that are in the map. First posted on arXiv 29 Nov 2024.

Builds on

29 of 37 references.

References · 29

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  9. 2016Improved Techniques for Training GANscited by 2,970
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  11. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  12. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
17 more
  1. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  2. 2021Domain Generalization: A Surveycited by 764
  3. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
  4. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  5. 2019Domain Generalization by Solving Jigsaw Puzzlescited by 450
  6. 2024YOLOv9: Learning What You Want to Learn Using Programmable Gradient Informationcited by 425
  7. 2023Teaching CLIP to Count to Tencited by 198
  8. 2021SelfReg: Self-supervised Contrastive Regularization for Domain Generalizationcited by 189
  9. 2023Flow Matching in Latent Spacecited by 160
  10. 2021Learning To Count Everythingcited by 150
  11. 2020Single-Side Domain Generalization for Face Anti-Spoofingcited by 139
  12. 2020Domain Generalization for Medical Imaging Classification with Linear-Dependency Regularizationcited by 123
  13. 2021Open Domain Generalization with Domain-Augmented Meta-Learningcited by 115
  14. 2020Learning to Learn with Variational Information Bottleneck for Domain Generalizationcited by 102
  15. 2024Make It Count: Text-to-Image Generation with an Accurate Number of Objectscited by 47
  16. 2018Learning to Count Objects in Natural Images for Visual Question Answeringcited by 40
  17. 2021A Bit More Bayesian: Domain-Invariant Learning with Uncertaintycited by 27

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.