StyleMaster: Stylize Your Video with Artistic Generation and Translation
Not on the map. Why?
Abstract (arXiv)
Style control has been popular in video generation models. Existing methods often generate videos far from the given style, cause content leakage, and struggle to transfer one video to the desired style. Our first observation is that the style extraction stage matters, whereas existing methods emphasize global style but ignore local textures. In order to bring texture features while preventing content leakage, we filter content-related patches while retaining style ones based on prompt-patch similarity; for global style extraction, we generate a paired style dataset through model illusion to facilitate contrastive learning, which greatly enhances the absolute style consistency. Moreover, to fill in the image-to-video gap, we train a lightweight motion adapter on still videos, which implicitly enhances stylization extent, and enables our image-trained model to be seamlessly applied to videos. Benefited from these efforts, our approach, StyleMaster, not only achieves significant improvement in both style resemblance and temporal coherence, but also can easily generalize to video style transfer with a gray tile ControlNet. Extensive experiments and visualizations demonstrate that StyleMaster significantly outperforms competitors, effectively generating high-quality stylized videos that align with textual content and closely resemble the style of reference images. Our project page is at https://zixuan-ye.github.io/stylemaster
Key facts. Cited by 47 papers in the map (data through 14 Oct 2026). Builds on 45 of its 54 references that are in the map. First posted on arXiv 10 Dec 2024.
Builds on
45 of 54 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
33 more
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2023Training-Free Layout Control with Cross-Attention Guidancecited by 313
- 2022Inversion-Based Style Transfer with Diffusion Modelscited by 291
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
- 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
- 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 196
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 170
- 2022UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detectioncited by 148
- 2024Implicit Style-Content Separation using B-LoRAcited by 135
- 2024Measuring Style Similarity in Diffusion Modelscited by 109
- 2017Coherent Online Video Style Transfercited by 96
- 2020Arbitrary Video Style Transfer via Multi-Channel Correlationcited by 84
- 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 78
- 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
- 2024InstantStyle-Plus: Style Transfer with Content-Preserving in Text-to-Image Generationcited by 53
- 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 50
- 2022ArtFID: Quantitative Evaluation of Neural Style Transfercited by 49
- 2023Visual Anagrams: Generating Multi-View Optical Illusions with Diffusion Modelscited by 46
- 2023ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptationcited by 40
- 2024StyleTokenizer: Defining Image Style by a Single Instance for Controlling Diffusion Modelscited by 32
- 2023CLAP: Isolating Content from Style through Contrastive Learning with Augmented Promptscited by 10
Built on by
Citing papers per year: 2025: 25; 2026: 22.
47 papers.
Sort:
By area:
- 2025Controllable Video Generation: A Surveycited by 98
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 66
- 2025AnyTalker: Scaling Multi-Person Talking Video Generation with Interactivity Refinementcited by 20
- 2025FullDiT2: Efficient In-Context Conditioning for Video Diffusion Transformerscited by 18
- 2025Video-As-Prompt: Unified Semantic Control for Video Generationcited by 14
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligencecited by 13
- 2025U-StyDiT: Ultra-high Quality Artistic Style Transfer Using Diffusion Transformerscited by 12
- 2025VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learningcited by 12
- 2025Any2Caption:Interpreting Any Condition to Caption for Controllable Video Generationcited by 10
- 2025STARFlow-V: End-to-End Video Generative Modeling with Normalizing Flowscited by 9
- 2025WorldWander: Bridging Egocentric and Exocentric Worlds in Video Generationcited by 9
35 more
- 2025CLIPGaussian: Universal and Multimodal Style Transfer Based on Gaussian Splattingcited by 8
- 2025VideoCoF: Unified Video Editing with Temporal Reasonercited by 8
- 2026VISTA: Triplet-Supervised Video Style Transfer with Diffusion Transformerscited by 8
- 2025FreeViS: Training-free Video Stylization with Inconsistent Referencescited by 6
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfercited by 6
- 2025DAM-VSR: Disentanglement of Appearance and Motion for Video Super-Resolutioncited by 5
- 2025VideoCanvas: Unified Video Completion from Arbitrary Spatiotemporal Patches via In-Context Conditioningcited by 5
- 2026TeleStyle: Content-Preserving Style Transfer in Images and Videoscited by 5
- 2026Untwisting RoPE: Frequency Control for Shared Attention in DiTscited by 5
- 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformerscited by 4
- 2026Versatile Editing of Video Content, Actions, and Dynamics without Trainingcited by 4
- 2025A Survey: Spatiotemporal Consistency in Video Generationcited by 3
- 2025PickStyle: Video-to-Video Style Transfer with Context-Style Adapterscited by 3
- 2026DreamStyle: A Unified Framework for Video Stylizationcited by 3
- 2026Tuning-free Visual Effect Transfer across Videoscited by 3
- 2026ProxyPose: 6-DoF Pose Tracking via Video-to-Video Translationcited by 3
- 2025ControlHair: Synergizing Physics Simulator and Video Diffusion for Controllable Dynamic Hair Renderingcited by 2
- 2025ViDiC: Video Difference Captioningcited by 2
- 2026StyleGallery: Training-free and Semantic-aware Personalized Style Transfer from Arbitrary Image Referencescited by 2
- 2025CamC2V: Context-aware Controllable Video Generationcited by 1
- 2025UniMMVSR: A Unified Multi-Modal Framework for Cascaded Video Super-Resolutioncited by 1
- 2025Insert In Style: A Zero-Shot Generative Framework for Harmonious Cross-Domain Object Compositioncited by 1
- 2026RFDM: Residual Flow Diffusion Model for Efficient Causal Video Editingcited by 1
- 2026TrajectoryMover: Generative Movement of Object Trajectories in Videoscited by 1
- 2026DiT as Real-Time Rerenderer: Streaming Video Stylization with Autoregressive Diffusion Transformercited by 1
- 2026Crafting Your Evolving Dreams: Concept-Incremental Versatile Customizationcited by 1
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generationcited by 1
- 2025Optimization-Free Style Transfer for 3D Gaussian Splatscited by 0
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRAcited by 0
- 2026When Numbers Speak: Aligning Textual Numerals and Visual Instances in Text-to-Video Diffusion Modelscited by 0
- 2026Sound Sparks Motion: Audio and Text Tuning for Video Editingcited by 0
- 2026Prompt2Effect: Training-Free Image-to-Video Model Specialization via LoRA Generationcited by 0
- 2026EchoStyle: Unlocking High-Fidelity Video Stylization with Reverse Data Synthesiscited by 0
- 2026ColorFM: An Optimization-to-Learning Framework for Color Transfer via Flow Matchingcited by 0
- 2026StyleComposer: Training-Free Multi-Reference Style Compositioncited by 0
- 2026StyleComposer: Training-Free Multi-Reference Style Composition5 Aug 2026
- 2026ColorFM: An Optimization-to-Learning Framework for Color Transfer via Flow Matching8 Jul 2026
- 2026ProxyPose: 6-DoF Pose Tracking via Video-to-Video Translation7 Jul 2026
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation24 Jun 2026
- 2026EchoStyle: Unlocking High-Fidelity Video Stylization with Reverse Data Synthesis24 Jun 2026
- 2026Prompt2Effect: Training-Free Image-to-Video Model Specialization via LoRA Generation11 Jun 2026
- 2026Crafting Your Evolving Dreams: Concept-Incremental Versatile Customization3 Jun 2026
- 2026VISTA: Triplet-Supervised Video Style Transfer with Diffusion Transformers17 May 2026
- 2026Sound Sparks Motion: Audio and Text Tuning for Video Editing14 May 2026
- 2026DiT as Real-Time Rerenderer: Streaming Video Stylization with Autoregressive Diffusion Transformer15 Apr 2026
- 2026When Numbers Speak: Aligning Textual Numerals and Visual Instances in Text-to-Video Diffusion Models9 Apr 2026
- 2026TrajectoryMover: Generative Movement of Object Trajectories in Videos31 Mar 2026
35 more
- 2026Versatile Editing of Video Content, Actions, and Dynamics without Training18 Mar 2026
- 2026StyleGallery: Training-free and Semantic-aware Personalized Style Transfer from Arbitrary Image References11 Mar 2026
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRA9 Mar 2026
- 2026RFDM: Residual Flow Diffusion Model for Efficient Causal Video Editing6 Feb 2026
- 2026Untwisting RoPE: Frequency Control for Shared Attention in DiTs4 Feb 2026
- 2026TeleStyle: Content-Preserving Style Transfer in Images and Videos28 Jan 2026
- 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformers21 Jan 2026
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfer20 Jan 2026
- 2026Tuning-free Visual Effect Transfer across Videos12 Jan 2026
- 2026DreamStyle: A Unified Framework for Video Stylization6 Jan 2026
- 2025VideoCoF: Unified Video Editing with Temporal Reasoner8 Dec 2025
- 2025ViDiC: Video Difference Captioning3 Dec 2025
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligence2 Dec 2025
- 2025AnyTalker: Scaling Multi-Person Talking Video Generation with Interactivity Refinement28 Nov 2025
- 2025WorldWander: Bridging Egocentric and Exocentric Worlds in Video Generation27 Nov 2025
- 2025STARFlow-V: End-to-End Video Generative Modeling with Normalizing Flows25 Nov 2025
- 2025Insert In Style: A Zero-Shot Generative Framework for Harmonious Cross-Domain Object Composition19 Nov 2025
- 2025VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learning29 Oct 2025
- 2025Video-As-Prompt: Unified Semantic Control for Video Generation23 Oct 2025
- 2025VideoCanvas: Unified Video Completion from Arbitrary Spatiotemporal Patches via In-Context Conditioning9 Oct 2025
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videos9 Oct 2025
- 2025UniMMVSR: A Unified Multi-Modal Framework for Cascaded Video Super-Resolution9 Oct 2025
- 2025PickStyle: Video-to-Video Style Transfer with Context-Style Adapters8 Oct 2025
- 2025FreeViS: Training-free Video Stylization with Inconsistent References2 Oct 2025
- 2025ControlHair: Synergizing Physics Simulator and Video Diffusion for Controllable Dynamic Hair Rendering25 Sep 2025
- 2025Optimization-Free Style Transfer for 3D Gaussian Splats7 Aug 2025
- 2025Controllable Video Generation: A Survey22 Jul 2025
- 2025DAM-VSR: Disentanglement of Appearance and Motion for Video Super-Resolution1 Jul 2025
- 2025FullDiT2: Efficient In-Context Conditioning for Video Diffusion Transformers4 Jun 2025
- 2025CLIPGaussian: Universal and Multimodal Style Transfer Based on Gaussian Splatting28 May 2025
- 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generation28 May 2025
- 2025CamC2V: Context-aware Controllable Video Generation8 Apr 2025
- 2025Any2Caption:Interpreting Any Condition to Caption for Controllable Video Generation31 Mar 2025
- 2025U-StyDiT: Ultra-high Quality Artistic Style Transfer Using Diffusion Transformers11 Mar 2025
- 2025A Survey: Spatiotemporal Consistency in Video Generation25 Feb 2025
- 2025FullDiT2: Efficient In-Context Conditioning for Video Diffusion Transformerscited by 18
- 2025U-StyDiT: Ultra-high Quality Artistic Style Transfer Using Diffusion Transformerscited by 12
- 2026VISTA: Triplet-Supervised Video Style Transfer with Diffusion Transformerscited by 8
- 2025DAM-VSR: Disentanglement of Appearance and Motion for Video Super-Resolutioncited by 5
- 2026TeleStyle: Content-Preserving Style Transfer in Images and Videoscited by 5
- 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformerscited by 4
- 2025PickStyle: Video-to-Video Style Transfer with Context-Style Adapterscited by 3
- 2025ControlHair: Synergizing Physics Simulator and Video Diffusion for Controllable Dynamic Hair Renderingcited by 2
- 2026StyleGallery: Training-free and Semantic-aware Personalized Style Transfer from Arbitrary Image Referencescited by 2
- 2025CamC2V: Context-aware Controllable Video Generationcited by 1
- 2026RFDM: Residual Flow Diffusion Model for Efficient Causal Video Editingcited by 1
- 2026DiT as Real-Time Rerenderer: Streaming Video Stylization with Autoregressive Diffusion Transformercited by 1
12 most cited of 16 All 16 (JSON)
- 2026ColorFM: An Optimization-to-Learning Framework for Color Transfer via Flow Matching8 Jul 2026
- 2026Prompt2Effect: Training-Free Image-to-Video Model Specialization via LoRA Generation11 Jun 2026
- 2026Crafting Your Evolving Dreams: Concept-Incremental Versatile Customization3 Jun 2026
- 2026VISTA: Triplet-Supervised Video Style Transfer with Diffusion Transformers17 May 2026
- 2026DiT as Real-Time Rerenderer: Streaming Video Stylization with Autoregressive Diffusion Transformer15 Apr 2026
- 2026When Numbers Speak: Aligning Textual Numerals and Visual Instances in Text-to-Video Diffusion Models9 Apr 2026
- 2026StyleGallery: Training-free and Semantic-aware Personalized Style Transfer from Arbitrary Image References11 Mar 2026
- 2026RFDM: Residual Flow Diffusion Model for Efficient Causal Video Editing6 Feb 2026
- 2026TeleStyle: Content-Preserving Style Transfer in Images and Videos28 Jan 2026
- 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformers21 Jan 2026
- 2025PickStyle: Video-to-Video Style Transfer with Context-Style Adapters8 Oct 2025
- 2025ControlHair: Synergizing Physics Simulator and Video Diffusion for Controllable Dynamic Hair Rendering25 Sep 2025
12 newest of 16 All 16 (JSON)
- 2025Controllable Video Generation: A Surveycited by 98
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 66
- 2025AnyTalker: Scaling Multi-Person Talking Video Generation with Interactivity Refinementcited by 20
- 2025Video-As-Prompt: Unified Semantic Control for Video Generationcited by 14
- 2025VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learningcited by 12
- 2025Any2Caption:Interpreting Any Condition to Caption for Controllable Video Generationcited by 10
- 2025STARFlow-V: End-to-End Video Generative Modeling with Normalizing Flowscited by 9
- 2025CLIPGaussian: Universal and Multimodal Style Transfer Based on Gaussian Splattingcited by 8
- 2025FreeViS: Training-free Video Stylization with Inconsistent Referencescited by 6
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfercited by 6
- 2025VideoCanvas: Unified Video Completion from Arbitrary Spatiotemporal Patches via In-Context Conditioningcited by 5
12 most cited of 28 All 28 (JSON)
- 2026StyleComposer: Training-Free Multi-Reference Style Composition5 Aug 2026
- 2026ProxyPose: 6-DoF Pose Tracking via Video-to-Video Translation7 Jul 2026
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation24 Jun 2026
- 2026EchoStyle: Unlocking High-Fidelity Video Stylization with Reverse Data Synthesis24 Jun 2026
- 2026Sound Sparks Motion: Audio and Text Tuning for Video Editing14 May 2026
- 2026TrajectoryMover: Generative Movement of Object Trajectories in Videos31 Mar 2026
- 2026Versatile Editing of Video Content, Actions, and Dynamics without Training18 Mar 2026
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRA9 Mar 2026
- 2026Untwisting RoPE: Frequency Control for Shared Attention in DiTs4 Feb 2026
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfer20 Jan 2026
- 2026Tuning-free Visual Effect Transfer across Videos12 Jan 2026
- 2026DreamStyle: A Unified Framework for Video Stylization6 Jan 2026
12 newest of 28 All 28 (JSON)