Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Models
Not on the map. Why?
Abstract (arXiv)
Connector-based video unified models have demonstrated strong capability in instruction-grounded video synthesis, but integrating a large high-fidelity generator into the unified training loop is computationally prohibitive, limiting achievable visual quality. We therefore propose Lumos-Nexus, a training-efficient unified video generation framework that facilitates the development of strong reasoning-driven generation capabilities while significantly enhancing visual fidelity. Lumos-Nexus adopts a two-stage design: 1) During training, only a lightweight generator is aligned with the understanding block to learn to take in reasoning-driven semantic control. 2) During inference, we introduce Unified Progressive Frequency Bridging (UPFB) to progressively hand off generation to a high-capacity pretrained generator in the shared latent space, enabling coarse-to-fine refinement and producing high-fidelity videos without compromising reasoning quality. To fill the gap in reasoning-driven video generation benchmarks, we introduce VR-Bench, which assesses a model's capability to translate inferred intent into coherent and semantically aligned video content. Extensive experiments demonstrate that Lumos-Nexus achieves substantial gains in visual realism and temporal coherence on VBench, while exhibiting strong reasoning-based generative performance on VR-Bench. Code and models are available at https://jiazheng-xing.github.io/nexus-lumos-home/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 57 of its 59 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
57 of 59 references.
References · 57
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
38 more
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 302
- 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
- 2025Transfer between Modalities with MetaQueriescited by 236
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
- 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 198
- 2024Autoregressive Video Generation without Vector Quantizationcited by 186
- 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 163
- 2023VDT: General-purpose Video Diffusion Transformers via Mask Modelingcited by 103
- 2024Loong: Generating Minute-level Long Videos with Autoregressive Language Modelscited by 99
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2025LongCat-Video Technical Reportcited by 85
- 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 66
50 most cited of 57 All 57 (JSON)
Built on by
Not cited yet.