Vorch-Director: Interactive World Story Model via Noise-Aware Error Rectification
On the map: Diffusion models → Video generation
Abstract (arXiv)
Autoregressive continuation provides a natural path toward minute-scale audio-visual generation by repeatedly extending a short-window generator conditioned on previously generated video and audio. However, models are trained on clean ground-truth histories, while inference relies on their own generated histories, where accumulated errors cause identity drift, over-smoothing, and audio-visual desynchronization. Recent methods reduce this mismatch by reusing prediction residuals as synthetic corruption, but we observe that the effectiveness of residual correction critically depends on the flow-matching noise level at which residuals are produced. We propose Vorch-Director, a noise-level-aware residual correction strategy that associates each residual with its originating noise level and injects residuals from matched noise regimes during training. By aligning injected errors with the denoising process, Vorch-Director produces more realistic autoregressive histories while retaining efficient teacher-forcing training. Built on the audio-visual LTX-2 diffusion transformer, Vorch-Director further introduces task embeddings to distinguish historical video, reference images, and target video, enabling unified conditioning for long-horizon generation. Together with a clean conditioning sink and mixed-task training, Vorch-Director supports multi-shot, multi-subject, reference-guided audio-visual long-video generation. We evaluate Vorch-Director on ST-Bench and introduce a new long-horizon audio-visual benchmark with metrics for quality drift and long-range consistency. Extensive experiments demonstrate improved stability and audio-visual fidelity over strong baselines.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 29 of its 31 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
29 of 31 references.
Closest ancestors · 15
Same direction, newest first
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models24 Jun
- 2026Towards Error-Free Long Video Generation21 Jun
- 2026TetherCache: Stabilizing Autoregressive Long-Form Video Generation with Gated Recall and Trusted Alignment11 Jun
- 2026FlowLong: Inference-time Long Video Generation via Manifold-constrained Tweedie Matching20 May
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
- 2026VideoAR: Autoregressive Video Generation via Next-Frame & Scale Prediction9 Jan
- 2025StoryMem: Multi-shot Long Video Storytelling with Memory22 Dec
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recycling10 Oct
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
- 2025Corruption-Aware Training of Latent Video Diffusion Models for Robust Text-to-Video Generation24 May
- 2025Error Analyses of Auto-Regressive Video Diffusion Models: A Unified Framework12 Mar
3 more
Other references · 14
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
- 2026VideoMemory: Toward Consistent Video Generation via Memory Integrationcited by 25
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 20
- 2025FilmWeaver: Weaving Consistent Multi-Shot Videos with Cache-Guided Autoregressive Diffusioncited by 10
- 2026AvatarForcing: One-Step Streaming Talking Avatars via Local-Future Sliding-Window Denoisingcited by 6
- 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generationcited by 6
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gatingcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds
- 2026Vorch-Omni: Multi-Task Orchestration of Sight and Sound
- 2026Training-Free Semantic Correction for Autoregressive Visual Models
- 2026Vorch-Human: Unified Multi-Task Human-Centric Generation via Long-Horizon Continuation
- 2026Self-Aligned Forcing: Streaming Video Diffusion with Differentiable Noisy History
- 2026Cycle-World: Mitigating Error Accumulation in Long-term Video World Models via Reverse-Prediction Cycle Consistency
- 2025DreamFoley: Scalable VLMs for High-Fidelity Video-to-Audio Generation
- 2026Recency Forcing: Bridging the Long-Horizon Gap in Autoregressive Video Generation