VibeFlow: Versatile Video Chroma-Lux Editing through Self-Supervised Learning
Not on the map. Why?
Abstract (arXiv)
Video chroma-lux editing, which aims to modify illumination and color while preserving structural and temporal fidelity, remains a significant challenge. Existing methods typically rely on expensive supervised training with synthetic paired data. This paper proposes VibeFlow, a novel self-supervised framework that unleashes the intrinsic physical understanding of pre-trained video generation models. Instead of learning color and light transitions from scratch, we introduce a disentangled data perturbation pipeline that enforces the model to adaptively recombine structure from source videos and color-illumination cues from reference images, enabling robust disentanglement in a self-supervised manner. Furthermore, to rectify discretization errors inherent in flow-based models, we introduce Residual Velocity Fields alongside a Structural Distortion Consistency Regularization, ensuring rigorous structural preservation and temporal coherence. Our framework eliminates the need for costly training resources and generalizes in a zero-shot manner to diverse applications, including video relighting, recoloring, low-light enhancement, day-night translation, and object-specific color editing. Extensive experiments demonstrate that VibeFlow achieves impressive visual quality with significantly reduced computational overhead. Our project is publicly available at https://lyf1212.github.io/VibeFlow-webpage.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 50 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
40 of 50 references.
References · 40
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
28 more
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
- 2025Video models are zero-shot learners and reasonerscited by 220
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2025Light-A-Video: Training-free Video Relighting via Progressive Light Fusioncited by 39
- 2024Control Color: Multimodal Diffusion-based Interactive Image Colorizationcited by 33
- 2025RelightVid: Temporal-Consistent Diffusion Model for Video Relightingcited by 29
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
- 2022BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorizationcited by 13
- 2025Lumen: Consistent Video Relighting and Harmonious Background Replacement with Video Generative Modelscited by 13
- 2021VCGAN: Video Colorization with Hybrid Generative Adversarial Networkcited by 12
- 2025UniLumos: Fast and Unified Image and Video Relighting with Physics-Plausible Feedbackcited by 12
- 2025TC-Light: Temporally Coherent Generative Rendering for Realistic World Transfercited by 11
- 2024ColorMNet: A Memory-based Deep Spatial-Temporal Feature Propagation Network for Video Colorizationcited by 8
- 2025RelightMaster: Precise Video Relighting with Multi-plane Light Imagescited by 8
- 2025PerTouch: VLM-Driven Agent for Personalized and Semantic Image Retouchingcited by 6
- 2025FlowPortal: Residual-Corrected Flow for Training-Free Video Relighting and Background Replacementcited by 6
- 2025ANYPORTAL: Zero-Shot Consistent Video Background Replacementcited by 5
- 2025Taming Flow-based I2V Models for Creative Video Editingcited by 5
- 2024L-C4: Language-Based Video Colorization for Creative and Consistent Colorcited by 1
Built on by
Not cited yet.