mlsanityData to 14 Oct 2026

VibeFlow: Versatile Video Chroma-Lux Editing through Self-Supervised Learning

arXiv 2604.13425 ↗First posted 15 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Video chroma-lux editing, which aims to modify illumination and color while preserving structural and temporal fidelity, remains a significant challenge. Existing methods typically rely on expensive supervised training with synthetic paired data. This paper proposes VibeFlow, a novel self-supervised framework that unleashes the intrinsic physical understanding of pre-trained video generation models. Instead of learning color and light transitions from scratch, we introduce a disentangled data perturbation pipeline that enforces the model to adaptively recombine structure from source videos and color-illumination cues from reference images, enabling robust disentanglement in a self-supervised manner. Furthermore, to rectify discretization errors inherent in flow-based models, we introduce Residual Velocity Fields alongside a Structural Distortion Consistency Regularization, ensuring rigorous structural preservation and temporal coherence. Our framework eliminates the need for costly training resources and generalizes in a zero-shot manner to diverse applications, including video relighting, recoloring, low-light enhancement, day-night translation, and object-specific color editing. Extensive experiments demonstrate that VibeFlow achieves impressive visual quality with significantly reduced computational overhead. Our project is publicly available at https://lyf1212.github.io/VibeFlow-webpage.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 50 references that are in the map. First posted on arXiv 15 Apr 2026.

Builds on

40 of 50 references.

References · 40

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  12. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
28 more
  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  3. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  4. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  5. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  6. 2025VACE: All-in-One Video Creation and Editingcited by 479
  7. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  8. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  9. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
  10. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  11. 2025Video models are zero-shot learners and reasonerscited by 220
  12. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  13. 2025Light-A-Video: Training-free Video Relighting via Progressive Light Fusioncited by 39
  14. 2024Control Color: Multimodal Diffusion-based Interactive Image Colorizationcited by 33
  15. 2025RelightVid: Temporal-Consistent Diffusion Model for Video Relightingcited by 29
  16. 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
  17. 2022BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorizationcited by 13
  18. 2025Lumen: Consistent Video Relighting and Harmonious Background Replacement with Video Generative Modelscited by 13
  19. 2021VCGAN: Video Colorization with Hybrid Generative Adversarial Networkcited by 12
  20. 2025UniLumos: Fast and Unified Image and Video Relighting with Physics-Plausible Feedbackcited by 12
  21. 2025TC-Light: Temporally Coherent Generative Rendering for Realistic World Transfercited by 11
  22. 2024ColorMNet: A Memory-based Deep Spatial-Temporal Feature Propagation Network for Video Colorizationcited by 8
  23. 2025RelightMaster: Precise Video Relighting with Multi-plane Light Imagescited by 8
  24. 2025PerTouch: VLM-Driven Agent for Personalized and Semantic Image Retouchingcited by 6
  25. 2025FlowPortal: Residual-Corrected Flow for Training-Free Video Relighting and Background Replacementcited by 6
  26. 2025ANYPORTAL: Zero-Shot Consistent Video Background Replacementcited by 5
  27. 2025Taming Flow-based I2V Models for Creative Video Editingcited by 5
  28. 2024L-C4: Language-Based Video Colorization for Creative and Consistent Colorcited by 1

Built on by

Not cited yet.