MTTN: Multi-Pair Text to Text Narratives for Prompt Generation
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
The increased interest in diffusion models has opened up opportunities for advancements in generative text modeling. These models can produce impressive images when given a well-crafted prompt, but creating a powerful or meaningful prompt can be hit-or-miss. To address this, we have created a large-scale dataset that is derived and synthesized from real prompts and indexed with popular image-text datasets such as MS-COCO and Flickr. We have also implemented stages that gradually reduce context and increase complexity, which will further enhance the output due to the complex annotations created. The dataset, called MTTN, includes over 2.4 million sentences divided into 5 stages, resulting in a total of over 12 million pairs, and a vocabulary of over 300,000 unique words, providing ample variation. The original 2.4 million pairs are designed to reflect the way language is used on the internet globally, making the dataset more robust for any model trained on it.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 9 of its 10 references that are in the map. First posted on arXiv 21 Jan 2023.
Builds on
9 of 10 references.
References · 9
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,352
- 2021WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learningcited by 285
- 2022MVP: Multi-task Supervised Pre-training for Natural Language Generationcited by 16
Built on by
Citing papers per year: 2024: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models
- 2025Boosting Text-To-Image Generation via Multilingual Prompting in Large Multimodal Models
- 2024Words Worth a Thousand Pictures: Measuring and Understanding Perceptual Variability in Text-to-Image Generation
- 2024Imagen 3
- 2024Dynamic Prompt Optimizing for Text-to-Image Generation
- 2023LLM Blueprint: Enabling Text-to-Image Generation with Complex and Detailed Prompts
- 2023Multi-Concept T2I-Zero: Tweaking Only The Text Embeddings and Nothing Else
- 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generation