mlsanityData to 14 Oct 2026

CelebV-Text: A Large-Scale Facial Text-Video Dataset

arXiv 2303.14717 ↗First posted 26 Mar 2023cs.CVcited by 104

Not on the map. Why?

Cited by 32 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Text-driven generation models are flourishing in video generation and editing. However, face-centric text-to-video generation remains a challenge due to the lack of a suitable dataset containing high-quality videos and highly relevant texts. This paper presents CelebV-Text, a large-scale, diverse, and high-quality dataset of facial text-video pairs, to facilitate research on facial text-to-video generation tasks. CelebV-Text comprises 70,000 in-the-wild face video clips with diverse visual content, each paired with 20 texts generated using the proposed semi-automatic text generation strategy. The provided texts are of high quality, describing both static and dynamic attributes precisely. The superiority of CelebV-Text over other datasets is demonstrated via comprehensive statistical analysis of the videos, texts, and text-video relevance. The effectiveness and potential of CelebV-Text are further shown through extensive self-evaluation. A benchmark is constructed with representative methods to standardize the evaluation of the facial text-to-video generation task. All data and models are publicly available.

Key facts. Cited by 104 papers in the map (data through 14 Oct 2026). Builds on 52 of its 81 references that are in the map. First posted on arXiv 26 Mar 2023.

Builds on

52 of 81 references.

References · 52

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2017Neural Discrete Representation Learningcited by 4,712
  4. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  5. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  6. 2022Video Diffusion Modelscited by 2,305
  7. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  9. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  10. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  11. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  12. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
38 more
  1. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  2. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
  3. 2018VoxCeleb2: Deep Speaker Recognitioncited by 875
  4. 2016Simple Online and Realtime Trackingcited by 868
  5. 2017Dense-Captioning Events in Videoscited by 793
  6. 2017VoxCeleb: a large-scale speaker identification datasetcited by 732
  7. 2017Localizing Moments in Video with Natural Languagecited by 663
  8. 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 619
  9. 2020Rescaling Egocentric Visioncited by 540
  10. 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
  11. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
  12. 2019VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Researchcited by 414
  13. 2018Quantifying Generalization in Reinforcement Learningcited by 352
  14. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
  15. 2022Flexible Diffusion Modeling of Long Videoscited by 294
  16. 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 256
  17. 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
  18. 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 250
  19. 2021CLIP2Video: Mastering Video-Text Retrieval via Image CLIPcited by 225
  20. 2019Cross-task weakly supervised learning from instructional videoscited by 199
  21. 2022Generating Videos with Dynamics-aware Implicit Generative Adversarial Networkscited by 186
  22. 2019Quality Assessment of In-the-Wild Videoscited by 164
  23. 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 163
  24. 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
  25. 2017Video Generation From Textcited by 154
  26. 2018FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Facescited by 119
  27. 2015Unsupervised Learning from Narrated Instruction Videoscited by 116
  28. 2018Cross-Modal and Hierarchical Modeling of Video and Textcited by 103
  29. 2014Video (language) modeling: a baseline for generative models of natural videoscited by 92
  30. 2021Make It Move: Controllable Image-to-Video Generation with Text Descriptionscited by 88
  31. 2018ReenactGAN: Learning to Reenact Faces via Boundary Transfercited by 85
  32. 2018To Create What You Tell: Generating Videos from Captionscited by 84
  33. 2022NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesiscited by 71
  34. 2018Imagine This! Scripts to Compositions to Videoscited by 54
  35. 2016Sync-DRAW: Automatic Video Generation using Deep Recurrent Attentive Architecturescited by 44
  36. 2022Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioningcited by 37
  37. 2015What's Cookin'? Interpreting Cooking Videos using Text, Speech and Visioncited by 31
  38. 2020Conditional Image Generation and Manipulation for User-Specified Contentcited by 20

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 11; 2024: 29; 2025: 45; 2026: 19.

104 papers.

Sort:

By area:

  1. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  2. 2023A Survey on Video Diffusion Modelscited by 206
  3. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
  4. 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 131
  5. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
  6. 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
  7. 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
  8. 2024Sonic: Shifting Focus to Global Audio Perception in Portrait Animationcited by 72
  9. 2024Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizercited by 64
  10. 2024Sora as a World Model? A Complete Survey on Text-to-Video Generationcited by 53
  11. 2023AutoDecoding Latent 3D Diffusion Modelscited by 50
  12. 2024FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portraitcited by 40
38 more
  1. 2025InfiniteYou: Flexible Photo Recrafting While Preserving Your Identitycited by 35
  2. 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformerscited by 34
  3. 2023TalkCLIP: Talking Head Generation with Text-Guided Expressive Speaking Stylescited by 32
  4. 2023MedShapeNet -- A Large-Scale Dataset of 3D Medical Shapes for Computer Visioncited by 32
  5. 2025Mavors: Multi-granularity Video Representation for Multimodal Large Language Modelcited by 32
  6. 2024InstantDrag: Improving Interactivity in Drag-based Image Editingcited by 31
  7. 2025SpeakerVid-5M: A Large-Scale High-Quality Dataset for Audio-Visual Dyadic Interactive Human Generationcited by 30
  8. 2025EchoShot: Multi-Shot Portrait Video Generationcited by 29
  9. 2024MultiTalk: Enhancing 3D Talking Head Generation Across Languages with Multilingual Video Datasetcited by 28
  10. 2023LaughTalk: Expressive 3D Talking Head Generation with Laughtercited by 27
  11. 2024From Sora What We Can See: A Survey of Text-to-Video Generationcited by 27
  12. 2023FT2TF: First-Person Statement Text-To-Talking Face Generationcited by 26
  13. 2025HOIGen-1M: A Large-scale Dataset for Human-Object Interaction Video Generationcited by 26
  14. 2025Human Motion Video Generation: A Surveycited by 25
  15. 20243D Face Tracking from 2D Video through Iterative Dense UV to Image Flowcited by 20
  16. 2024Joker: Conditional 3D Head Synthesis with Extreme Facial Expressionscited by 18
  17. 2024Omni-ID: Holistic Identity Representation Designed for Generative Taskscited by 18
  18. 2025Audio-visual Controlled Video Diffusion with Masked Selective State Spaces Modeling for Natural Talking Head Generationcited by 17
  19. 2024MMHead: Towards Fine-grained Multi-modal 3D Facial Animationcited by 16
  20. 2024PERSE: Personalized 3D Generative Avatars from A Single Portraitcited by 15
  21. 202415M Multimodal Facial Image-Text Datasetcited by 14
  22. 2025MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animationcited by 14
  23. 2025FVQ: A Large-Scale Dataset and an LMM-based Method for Face Video Quality Assessmentcited by 13
  24. 2023AgentAvatar: Disentangling Planning, Driving and Rendering for Photorealistic Avatar Agentscited by 11
  25. 2025KeyFace: Expressive Audio-Driven Facial Animation for Long Sequences via KeyFrame Interpolationcited by 11
  26. 2025VoiceCraft-Dub: Automated Video Dubbing with Neural Codec Language Modelscited by 11
  27. 2025KeySync: A Robust Approach for Leakage-free Lip Synchronization in High Resolutioncited by 11
  28. 2025We'll Fix it in Post: Improving Text-to-Video Generation with Neuro-Symbolic Feedbackcited by 10
  29. 2025Towards Interactive Intelligence for Digital Humanscited by 10
  30. 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervisioncited by 10
  31. 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applicationscited by 9
  32. 2024DH-FaceVid-1K: A Large-Scale High-Quality Dataset for Face Video Generationcited by 9
  33. 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
  34. 2024What to Preserve and What to Transfer: Faithful, Identity-Preserving Diffusion-based Hairstyle Transfercited by 8
  35. 2024HumanVLM: Foundation for Human-Scene Vision-Language Modelcited by 8
  36. 2025UniGaze: Towards Universal Gaze Estimation via Large-scale Pre-Trainingcited by 8
  37. 2025Playmate: Flexible Control of Portrait Animation via 3D-Implicit Space Guided Diffusioncited by 8
  38. 2024A Survey on Future Frame Synthesis: Bridging Deterministic and Generative Approachescited by 7

50 most cited of 104 All 104 (JSON)