Cycle-World: Mitigating Error Accumulation in Long-term Video World Models via Reverse-Prediction Cycle Consistency
On the map: World models → Video-generation world models and simulators
also in 1 more
Abstract (arXiv)
Autoregressive diffusion models have enabled high-quality video generation, yet their sequential nature inherently suffers from error accumulation. In long-horizon video synthesis, minor prediction deviations compound over time, inevitably leading to unconstrained generative drift, structural collapse, and severe visual degradation. To address this, we propose Cycle-World, a novel framework designed for stable and temporally consistent long-video generation. Our approach tackles error drift by enforcing strict temporal reversibility across both the training and inference phases. Theoretically, we demonstrate that forward generative drift can be strictly bottlenecked by a cycle-consistency objective. During training, we integrate an efficient reverse-prediction model to implicitly embed causal constraints into the forward generator, compelling it to produce reversible sequences that tightly adhere to the natural video manifold. At inference time, we repurpose this frozen reverse model as a runtime corrector. Through gradient-based cycle guidance, it iteratively refines the generated latent representations, actively suppressing accumulated errors before they are committed to the historical context. Extensive experiments on the VBench benchmark demonstrate that Cycle-World's dual-phase synergy significantly mitigates error drift, achieving state-of-the-art overall generation quality and long-horizon temporal consistency in 60-second synthesis.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 52 of its 59 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
52 of 59 references.
Closest ancestors · 9
Same direction, newest first
- 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data1 Jun
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024Open-Sora: Democratizing Efficient Video Production for All29 Dec
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 43
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
31 more
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
- 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 332
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
- 2024Autoregressive Video Generation without Vector Quantizationcited by 180
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
- 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 173
- 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 170
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 135
- 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 124
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 78
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
- 2025Ovi: Twin Backbone Cross-Modal Fusion for Audio-Video Generationcited by 76
- 2025UniVerse-1: Unified Audio-Video Generation via Stitching of Expertscited by 58
- 2026Context Forcing: Consistent Autoregressive Video Generation with Long Contextcited by 47
- 2024LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexitycited by 41
- 2025UniAVGen: Unified Audio and Video Generation with Asymmetric Cross-Modal Interactionscited by 35
- 2021Temporally Consistent Video Colorization with Deep Feature Propagation and Self-regularization Learningcited by 22
- 2026JavisDiT++: Unified Modeling and Optimization for Joint Audio-Video Generationcited by 22
- 2025Harmony: Harmonizing Audio and Video Generation through Cross-Task Synergycited by 19
- 2025OmniVCus: Feedforward Subject-driven Video Customization with Multimodal Control Conditionscited by 17
- 2025UltraGen: High-Resolution Video Generation with Hierarchical Attentioncited by 17
- 2025PolyVivid: Vivid Multi-Subject Video Generation with Cross-Modal Interaction and Enhancementcited by 16
- 2021A causal convolutional neural network for multi-subject motion modeling and generationcited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026TokenTrim: Inference-Time Token Pruning for Autoregressive Long Video Generation
- 2026Mitigating Compounding Error via Video Representation Regularization
- 2026LIVE: Long-horizon Interactive Video World Modeling
- 2026Can Video Diffusion Models Predict Past Frames? Bidirectional Cycle Consistency for Reversible Interpolation
- 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistency
- 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perception
- 2026The Past Frames the Future: Memory for Autoregressive Video Generation
- 2026Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model