AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent advances in subject-driven video generation with large diffusion models have enabled personalized content synthesis conditioned on user-provided subjects. However, existing methods lack fine-grained temporal control over subject appearance and disappearance, which are essential for applications such as compositional video synthesis, storyboarding, and controllable animation. We propose AlcheMinT, a unified framework that introduces explicit timestamps conditioning for subject-driven video generation. Our approach introduces a novel positional encoding mechanism that unlocks the encoding of temporal intervals, associated in our case with subject identities, while seamlessly integrating with the pretrained video generation model positional embeddings. Additionally, we incorporate subject-descriptive text tokens to strengthen binding between visual identity and video captions, mitigating ambiguity during generation. Through token-wise concatenation, AlcheMinT avoids any additional cross-attention modules and incurs negligible parameter overhead. We establish a benchmark evaluating multiple subject identity preservation, video fidelity, and temporal adherence. Experimental results demonstrate that AlcheMinT achieves visual quality matching state-of-the-art video personalization methods, while, for the first time, enabling precise temporal control over multi-subject generation within videos. Project page is at https://snap-research.github.io/Video-AlcheMinT
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 54 of its 63 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
54 of 63 references.
Closest ancestors · 19
Same direction, newest first
- 2025BindWeave: Subject-Consistent Video Generation via Cross-Modal Integration1 Oct
- 2025Tora2: Motion and Appearance Customized Diffusion Transformer for Multi-Entity Video Generation8 Jul
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformers3 Apr
- 2025Tuning-Free Multi-Event Long Video Generation via Synchronized Coupled Sampling11 Mar
- 2025VACE: All-in-One Video Creation and Editing10 Mar
- 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuning8 Jan
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024VIMI: Grounding Video Generation through Multi-modal Instruction8 Jul
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation2 May
- 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjects18 Jan
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion7 Dec
- 2023MEVG: Multi-event Video Generation with Text-to-Video Models7 Dec
7 more
- 2023VideoBooth: Diffusion-based Video Generation with Image Prompts1 Dec
- 2023AnyDoor: Zero-shot Object-level Image Customization18 Jul
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
- 2023Motion-Conditioned Diffusion Model for Controllable Video Synthesis27 Apr
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
- 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation15 Mar
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Models20 Nov
Other references · 35
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
23 more
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2025Qwen-Image Technical Reportcited by 973
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
- 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 224
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
- 2024Training-Free Consistent Text-to-Image Generationcited by 123
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
- 2023Domain-Agnostic Tuning-Encoder for Fast Personalization of Text-To-Image Modelscited by 85
- 2023Face0: Instantaneously Conditioning a Text-to-Image Model on a Facecited by 77
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
- 2025Multi-subject Open-set Personalization in Video Generationcited by 65
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 58
- 2024Mind the Time: Temporally-Controlled Multi-Event Video Generationcited by 39
- 2024Customizing Text-to-Image Models with a Single Image Paircited by 36
- 2023StoryBench: A Multifaceted Benchmark for Continuous Story Visualizationcited by 27
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generation
- 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidance
- 2026LumosX: Relate Any Identities with Their Attributes for Personalized Video Generation
- 2023VideoDreamer: Customized Multi-Subject Text-to-Video Generation with Disen-Mix Finetuning on Language-Video Foundation Models
- 2026MSR: Multiple Subject Reference for Video Generation
- 2026Identity-Preserving Text-to-Video Generation via Agentic Enhancement and Semantic Repair
- 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement