When Numbers Speak: Aligning Textual Numerals and Visual Instances in Text-to-Video Diffusion Models
On the map: Diffusion models → Video generation
Abstract (arXiv)
Text-to-video diffusion models have enabled open-ended video synthesis, but often struggle with generating the correct number of objects specified in a prompt. We introduce NUMINA , a training-free identify-then-guide framework for improved numerical alignment. NUMINA identifies prompt-layout inconsistencies by selecting discriminative self- and cross-attention heads to derive a countable latent layout. It then refines this layout conservatively and modulates cross-attention to guide regeneration. On the introduced CountBench, NUMINA improves counting accuracy by up to 7.4% on Wan2.1-1.3B, and by 4.9% and 5.5% on 5B and 14B models, respectively. Furthermore, CLIP alignment is improved while maintaining temporal consistency. These results demonstrate that structural guidance complements seed search and prompt enhancement, offering a practical path toward count-accurate text-to-video diffusion. The code is available at https://github.com/H-EmbodVis/NUMINA.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 63 of its 72 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
63 of 72 references.
Closest ancestors · 21
Same direction, newest first
- 2025Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Caching3 Jul
- 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editing24 Feb
- 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation24 Dec
- 2024Free2Guide: Training-Free Text-to-Video Alignment using Image LVLM26 Nov
- 2024Towards Precise Scaling Laws for Video Diffusion Transformers25 Nov
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024ReVideo: Remake a Video with Motion and Content Control22 May
- 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
- 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence4 Dec
9 more
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
- 2023Ground-A-Video: Zero-shot Grounded Video Editing using Text-to-image Diffusion Models2 Oct
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
- 2023Dreamix: Video Diffusion Models are General Video Editors2 Feb
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
- 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct
- 2022Video Diffusion Models7 Apr
Other references · 42
- 2023Segment Anythingcited by 8,234
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
30 more
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 310
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
- 2023Segment and Track Anythingcited by 193
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
- 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
- 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 93
- 2023GenTron: Diffusion Transformers for Image and Video Generationcited by 82
- 2022An End-to-End Transformer Model for Crowd Localizationcited by 74
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
- 2021TransCrowd: weakly-supervised crowd counting with transformerscited by 61
- 2023Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolutioncited by 59
- 2024Towards A Better Metric for Text-to-Video Generationcited by 51
- 2024UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editingcited by 48
- 2023CrowdCLIP: Unsupervised Crowd Counting via Vision-Language Modelcited by 47
- 2024Make It Count: Text-to-Image Generation with an Accurate Number of Objectscited by 47
- 2024StyleMaster: Stylize Your Video with Artistic Generation and Translationcited by 47
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2021Focal Inverse Distance Transform Maps for Crowd Localizationcited by 36
- 2025The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generationcited by 21
- 2025OmnimatteZero: Fast Training-free Omnimatte with Pre-trained Video Diffusion Modelscited by 16
- 2025DriVerse: Navigation World Model for Driving Simulation via Multimodal Trajectory Prompting and Motion Alignmentcited by 16
- 2025Towards Transformer-Based Aligned Generation with Self-Coherence Guidancecited by 14
- 2024SOOD++: Leveraging Unlabeled Data to Boost Oriented Object Detectioncited by 12
- 2025DualDiff+: Dual-Branch Diffusion for High-Fidelity Video Generation with Reward Guidancecited by 6
- 2025FVAR: Visual Autoregressive Modeling via Next Focus Predictioncited by 4
- 2024Towards Online Real-Time Memory-based Video Inpainting Transformerscited by 3
- 2025Video4Edit: Viewing Image Editing as a Degenerate Temporal Processcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Prompt-A-Video: Prompt Your Video Diffusion Model via Preference-Aligned LLM
- 2025Demystifying Numerosity in Diffusion Models -- Limitations and Remedies
- 2025Inference-Time Text-to-Video Alignment with Diffusion Latent Beam Search
- 2026SARA: Semantically Adaptive Relational Alignment for Video Diffusion Models
- 2026NoisEasier: Test-Time Noise Optimization for Text-to-Video Generation
- 2023MagDiff: Multi-Alignment Diffusion for High-Fidelity Video Generation and Editing
- 2025CountSteer: Steering Attention for Object Counting in Diffusion Models
- 2024Improving Long-Text Alignment for Text-to-Image Diffusion Models