mlsanityData to 13 Oct 2026

OSP-Next: Efficient High-Quality Video Generation with Sparse Sequence Parallelism, HiF8 Quantization, and Reinforcement Learning

arXiv 2605.28691 ↗First posted 27 May 2026cs.CVcited by 1

On the map: Diffusion models → Video generation

also in 1 more
Abstract (arXiv)

Diffusion Transformers achieve strong video generation quality, but the quadratic cost of full attention limits efficiency. We introduce OSP-Next, an efficient text-to-video generation model that integrates sparse attention, parallelism, quantization, and reinforcement learning. OSP-Next uses a hybrid full-sparse attention architecture, where the sparse component is implemented with Skiparse-2D Attention. This fixed-pattern mechanism applies token-wise and group-wise sparse attention along spatial dimensions, leveraging locality while maintaining native compatibility with FlashAttention kernels. Based on the local equivalence of rearrangement in Skiparse-2D Attention, we further propose Sparse Sequence Parallelism (SSP), which partitions subsequences across ranks and switches sparse patterns through a single All-to-All communication. Compared with Ulysses Sequence Parallelism (SP), SSP provides a native parallel strategy for sparse attention and reduces communication volume by 75%. OSP-Next also incorporates HiF8 quantization to enable stable joint training with 8-bit quantization and sparse fine-tuning, and applies Mix-GRPO post-training to improve the performance of the sparse model. Experiments show that OSP-Next achieves a VBench total score of 83.73%, surpassing the Wan2.1 baseline. Under the 5-second 720P and 5-second 768P settings, OSP-Next achieves up to 1.64× single-GPU speedup and over 1.52× eight-GPU speedup on NVIDIA H200 GPUs. In addition, with only a 0.4% drop in VBench total score, OSP-Next-HiF8 achieves 1.69× and 2.27× speedups under the two settings on a single Ascend 950PR, demonstrating the efficiency and performance of OSP-Next across hardware platforms.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 46 of its 46 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

46 of 46 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026SLA2: Sparse-Linear Attention with Learnable Routing and QAT13 Feb
  2. 2025TurboDiffusion: Accelerating Video Diffusion Models by 100-200 Times18 Dec
  3. 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer29 Sep
  4. 2025SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse-Linear Attention28 Sep
  5. 2025Sparse-vDiT: Unleashing the Power of Sparse Attention to Accelerate Video Diffusion Transformers3 Jun
  6. 2025Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation24 May
  7. 2025VSA: Faster Video Diffusion with Trainable Sparse Attention19 May
  8. 2025Training-free and Adaptive Sparse Attention for Efficient Long Video Generation28 Feb
  9. 2025Fast Video Generation with Sliding Tile Attention6 Feb
  10. 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity3 Feb
  11. 2025Improving Video Generation with Human Feedback23 Jan
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
1 more
  1. 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan

Other references · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
  4. 2022Scalable Diffusion Models with Transformerscited by 5,973
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,130
  6. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,637
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,610
  8. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,570
  9. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,851
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,775
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,625
  12. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 647
21 more
  1. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 642
  2. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 625
  3. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 515
  4. 2023Ring Attention with Blockwise Transformers for Near-Infinite Contextcited by 452
  5. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 401
  6. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 379
  7. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 288
  8. 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 241
  9. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 213
  10. 2022FP8 Formats for Deep Learningcited by 192
  11. 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 181
  12. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 174
  13. 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 160
  14. 2024SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationcited by 159
  15. 2025HunyuanVideo 1.5 Technical Reportcited by 152
  16. 2025SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inferencecited by 118
  17. 2025BranchGRPO: Stable and Efficient GRPO with Structured Branching in Diffusion Modelscited by 61
  18. 2024USP: A Unified Sequence Parallelism Approach for Long Context Generative AIcited by 59
  19. 2025Recipes for Pre-training LLMs with MXFP8cited by 21
  20. 2024Ascend HiFloat8 Format for Deep Learningcited by 7
  21. 2025FlashI2V: Fourier-Guided Latent Shifting Prevents Conditional Image Leakage in Image-to-Video Generationcited by 2

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Accelerating Text-to-Video Generation with Calibrated Sparse Attention
  2. 2026Ride the Wave: Precision-Allocated Sparse Attention for Smooth Video Generation
  3. 2025Compact Attention: Exploiting Structured Spatio-Temporal Sparsity for Fast Video Generation
  4. 2025Trainable Log-linear Sparse Attention for Efficient Diffusion Transformers
  5. 2026Veda: Scalable Video Diffusion via Distilled Sparse Attention
  6. 2026Light Forcing: Accelerating Autoregressive Video Diffusion via Sparse Attention
  7. 2025Radial Attention: O(nlog n) Sparse Attention with Energy Decay for Long Video Generation
  8. 2025FPSAttention: Training-Aware FP8 and Sparsity Co-Design for Fast Video Diffusion