mlsanityData to 14 Oct 2026

Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Models

arXiv 2605.31603 ↗First posted 29 May 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Connector-based video unified models have demonstrated strong capability in instruction-grounded video synthesis, but integrating a large high-fidelity generator into the unified training loop is computationally prohibitive, limiting achievable visual quality. We therefore propose Lumos-Nexus, a training-efficient unified video generation framework that facilitates the development of strong reasoning-driven generation capabilities while significantly enhancing visual fidelity. Lumos-Nexus adopts a two-stage design: 1) During training, only a lightweight generator is aligned with the understanding block to learn to take in reasoning-driven semantic control. 2) During inference, we introduce Unified Progressive Frequency Bridging (UPFB) to progressively hand off generation to a high-capacity pretrained generator in the shared latent space, enabling coarse-to-fine refinement and producing high-fidelity videos without compromising reasoning quality. To fill the gap in reasoning-driven video generation benchmarks, we introduce VR-Bench, which assesses a model's capability to translate inferred intent into coherent and semantically aligned video content. Extensive experiments demonstrate that Lumos-Nexus achieves substantial gains in visual realism and temporal coherence on VBench, while exhibiting strong reasoning-based generative performance on VR-Bench. Code and models are available at https://jiazheng-xing.github.io/nexus-lumos-home/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 57 of its 59 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

57 of 59 references.

References · 57

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  9. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  10. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  12. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
38 more
  1. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  2. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  3. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  4. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  5. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  6. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  7. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  8. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  9. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  10. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
  11. 2023ModelScope Text-to-Video Technical Reportcited by 658
  12. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  13. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
  14. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  15. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  16. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
  17. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  18. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  19. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  20. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  21. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  22. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
  23. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
  24. 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 302
  25. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
  26. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
  27. 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
  28. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  29. 2025Transfer between Modalities with MetaQueriescited by 236
  30. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
  31. 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 198
  32. 2024Autoregressive Video Generation without Vector Quantizationcited by 186
  33. 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 163
  34. 2023VDT: General-purpose Video Diffusion Transformers via Mask Modelingcited by 103
  35. 2024Loong: Generating Minute-level Long Videos with Autoregressive Language Modelscited by 99
  36. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
  37. 2025LongCat-Video Technical Reportcited by 85
  38. 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 66

50 most cited of 57 All 57 (JSON)

Built on by

Not cited yet.