DreaMontage: Arbitrary Frame-Guided One-Shot Video Generation
Not on the map. Why?
Abstract (arXiv)
The "one-shot" technique represents a distinct and sophisticated aesthetic in filmmaking. However, its practical realization is often hindered by prohibitive costs and complex real-world constraints. Although emerging video generation models offer a virtual alternative, existing approaches typically rely on naive clip concatenation, which frequently fails to maintain visual smoothness and temporal coherence. In this paper, we introduce DreaMontage, a comprehensive framework designed for arbitrary frame-guided generation, capable of synthesizing seamless, expressive, and long-duration one-shot videos from diverse user-provided inputs. To achieve this, we address the challenge through three primary dimensions. (i) We integrate a lightweight intermediate-conditioning mechanism into the DiT architecture. By employing an Adaptive Tuning strategy that effectively leverages base training data, we unlock robust arbitrary-frame control capabilities. (ii) To enhance visual fidelity and cinematic expressiveness, we curate a high-quality dataset and implement a Visual Expression SFT stage. In addressing critical issues such as subject motion rationality and transition smoothness, we apply a Tailored DPO scheme, which significantly improves the success rate and usability of the generated content. (iii) To facilitate the production of extended sequences, we design a Segment-wise Auto-Regressive (SAR) inference strategy that operates in a memory-efficient manner. Extensive experiments demonstrate that our approach achieves visually striking and seamlessly coherent one-shot effects while maintaining computational efficiency, empowering users to transform fragmented visual materials into vivid, cohesive one-shot cinematic experiences.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 27 of its 32 references that are in the map. First posted on arXiv 24 Dec 2025.
Builds on
27 of 32 references.
References · 27
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
15 more
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 254
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
- 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 81
- 2025LongCat-Video Technical Reportcited by 73
- 2024Cal-DPO: Calibrated Direct Preference Optimization for Language Model Alignmentcited by 50
- 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 44
- 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 38
- 2024I2VControl: Disentangled and Unified Video Motion Synthesis Controlcited by 19
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026SparkVSR: Interactive Video Super-Resolution via Sparse Keyframe Propagationcited by 5
- 2026AnyRecon: Arbitrary-View 3D Reconstruction with Video Diffusion Modelcited by 4
- 2026SmartDirector: Keyframe-Conditioned Cinematic Video Generation with Narrative Pacing Controlcited by 2
- 2026KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generationcited by 1
- 2026KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generation15 Jul 2026
- 2026SmartDirector: Keyframe-Conditioned Cinematic Video Generation with Narrative Pacing Control27 May 2026
- 2026AnyRecon: Arbitrary-View 3D Reconstruction with Video Diffusion Model21 Apr 2026
- 2026SparkVSR: Interactive Video Super-Resolution via Sparse Keyframe Propagation17 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026ShotPlan: Cinematic Video Generation with Learnable Planning Token
- 2023DreamVideo: High-Fidelity Image-to-Video Generation with Image Retention and Text Guidance
- 2024DreamCinema: Cinematic Transfer with Free Camera and 3D Character
- 2024Can video generation replace cinematographers? Research on the cinematic language of generated video
- 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Models
- 2026DreamLoop: Controllable Cinemagraph Generation from a Single Photograph
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling
- 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Model