SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Flow Matching has enabled robust text-to-video generation via latent ODE sampling. However, velocity approximation and numerical discretization errors inevitably accumulate, causing sampling trajectories to drift. Consequently, generated videos often suffer from severe spatiotemporal inconsistencies. Nevertheless, directly correcting these drifted, noisy latents is challenging: (i) timestep-dependent noise obscures reliable structural cues; (ii) spatial interventions risk disrupting intricate local geometry while incurring heavy computational costs. To address this, we propose Spectral Lookahead Rectification (SpecLoR), a plug-and-play inference method that bypasses noise via lookahead prediction, and circumvents spatiotemporal entanglement by shifting corrections to the frequency domain, where universal statistical priors of natural videos are readily available. First, during early sampling stages, SpecLoR looks ahead to estimate the clean latent zt,0 and computes its 3D spatiotemporal spectrum. Next, SpecLoR rectifies the amplitude spectrum to match the prior, leaving the phase intact. Finally, the corrected state is re-noised to resume ODE integration. Experiments on Wan2.2 demonstrate that SpecLoR significantly reduces physical artifacts and enhances motion coherence across multiple benchmarks with minimal computational overhead (4 additional NFEs).
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 51 of its 55 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
51 of 55 references.
Closest ancestors · 15
Same direction, newest first
- 2025Structure From Tracking: Distilling Structure-Preserving Motion for Video Generation12 Dec
- 2025MotionRAG: Motion Retrieval-Augmented Image-to-Video Generation30 Sep
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Models10 Jun
- 2025FlowMo: Variance-Based Flow Guidance for Coherent Motion in Video Generation1 Jun
- 2025RoPECraft: Training-Free Motion Transfer with Trajectory-Guided RoPE Optimization on Diffusion Transformers19 May
- 2025LongDiff: Training-Free Long Video Generation in One Go23 Mar
- 2025FreqPrior: Improving Video Diffusion Models with Frequency Filtering Gaussian Noise5 Feb
- 2025Inference-Time Text-to-Video Alignment with Diffusion Latent Beam Search31 Jan
- 2025Improving Video Generation with Human Feedback23 Jan
- 2024Optical-Flow Guided Prompt Optimization for Coherent Video Generation23 Nov
- 2024VideoGuide: Improving Video Diffusion Models without Training Through a Teacher's Guide6 Oct
- 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attention29 Jul
3 more
Other references · 36
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
- 2022Scalable Diffusion Models with Transformerscited by 5,973
- 2022Classifier-Free Diffusion Guidancecited by 5,785
- 2022Flow Matching for Generative Modelingcited by 5,542
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,607
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,610
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,775
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,625
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 979
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 624
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 492
24 more
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 477
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 473
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 444
- 2025A General Framework for Inference-time Scaling and Steering of Diffusion Modelscited by 217
- 2023FreeU: Free Lunch in Diffusion U-Netcited by 196
- 2025HunyuanVideo 1.5 Technical Reportcited by 152
- 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 113
- 2023Restart Sampling for Improving Generative Processescited by 82
- 2025Kling-Omni Technical Reportcited by 66
- 2025Waver: Wave Your Way to Lifelike Video Generationcited by 52
- 2025CFG-Zero*: Improved Classifier-Free Guidance for Flow Matching Modelscited by 50
- 2024Improved Video VAE for Latent Video Diffusion Modelcited by 46
- 2025Video-T1: Test-Time Scaling for Video Generationcited by 39
- 2025Scaling Image and Video Generation via Test-Time Evolutionary Searchcited by 39
- 2025VideoScore2: Think before You Score in Generative Video Evaluationcited by 37
- 2025How I Warped Your Noise: a Temporally-Correlated Noise Prior for Diffusion Modelscited by 32
- 2025Test-Time Scaling of Diffusion Models via Noise Trajectory Searchcited by 29
- 2025InfLVG: Reinforce Inference-Time Consistent Long Video Generation with GRPOcited by 15
- 2026Self-Refining Video Samplingcited by 14
- 2025A Theoretical Analysis of Discrete Flow Matching Generative Modelscited by 13
- 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusioncited by 12
- 2024Diffusion Rejection Samplingcited by 11
- 2025Enhance-A-Video: Better Generated Video for Freecited by 11
- 2025Temporal Regularization Makes Your Video Generator Strongercited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FlowLong: Inference-time Long Video Generation via Manifold-constrained Tweedie Matching
- 2026From Diffusion to Flow: Efficient Motion Generation in MotionGPT3
- 2024MotionAura: Generating High-Quality and Motion Consistent Videos using Discrete Diffusion
- 2026DiReCT: Disentangled Regularization of Contrastive Trajectories for Physics-Refined Video Generation
- 2025Physics-Guided Motion Loss for Video Generation Model
- 2026Mode Seeking meets Mean Seeking for Fast Long Video Generation
- 2026TeDiO: Temporal Diagonal Optimization for Training-Free Coherent Video Diffusion
- 2025EfficientMT: Efficient Temporal Adaptation for Motion Transfer in Text-to-Video Diffusion Models