mlsanityData to 7 Oct 2026

LIVEditor-14B: Lightning Unified Video Editing via In-Context Sparse Attention

arXiv 2605.04569 ↗First posted 6 May 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Video editing has evolved toward In-Context Learning (ICL) paradigms, yet the resulting quadratic attention costs create a critical computational bottleneck. In this work, we propose In-context Sparse Attention (ISA), the first near-lossless empirical sparse framework tailored for ICL video editing. Our design is grounded in two key insights: first, context tokens exhibit significantly lower saliency than source tokens; second, we theoretically prove and empirically validate that Query sharpness correlates with approximation error. Motivated by these findings, ISA implements an efficient pre-selection strategy to prune redundant context, followed by a dynamic query grouping mechanism that routes high-error queries to full attention and low-error ones to a computationally efficient 0-th order Taylor sparse attention. Furthermore, we build textbftextttLIVEditor-14B , a novel lightning video editing model via ISA and a proposed video-editing data pipeline that curated a 1.7M high-quality dataset. Extensive experiments demonstrate that LIVEditor-14B achieves a ~60% reduction in attention-module latency while surpassing state-of-the-art methods across EditVerseBench, IVE-Bench, and VIE-Bench, delivering near-lossless acceleration without compromising visual fidelity.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 47 of its 52 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

47 of 52 references.

References · 47

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  4. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  5. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  6. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  7. 2025VACE: All-in-One Video Creation and Editingcited by 467
  8. 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 414
  9. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
  10. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  11. 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 200
  12. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
35 more
  1. 2025HunyuanVideo 1.5 Technical Reportcited by 148
  2. 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
  3. 2025Fast Video Generation with Sliding Tile Attentioncited by 123
  4. 2025SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inferencecited by 113
  5. 2025VSA: Faster Video Diffusion with Trainable Sparse Attentioncited by 100
  6. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
  7. 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
  8. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 79
  9. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
  10. 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 73
  11. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  12. 2025UNIC: Unified In-Context Video Editingcited by 53
  13. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 53
  14. 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 49
  15. 2025TileLang: A Composable Tiled Programming Model for AI Systemscited by 42
  16. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 42
  17. 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generationcited by 39
  18. 2024Alignment of Diffusion Models: Fundamentals, Challenges, and Futurecited by 34
  19. 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 34
  20. 2025InstructX: Towards Unified Visual Editing with MLLM Guidancecited by 31
  21. 2025IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessmentcited by 27
  22. 2024StableV2V: Stablizing Shape Consistency in Video-to-Video Editingcited by 25
  23. 2025Region-Constraint In-Context Generation for Instructional Video Editingcited by 22
  24. 2024Video Diffusion Models are Strong Video Inpaintercited by 21
  25. 2025Sliding Window Attention Training for Efficient Large Language Modelscited by 21
  26. 2025MagicDistillation: Weak-to-Strong Video Distillation for Large-Scale Few-Step Synthesiscited by 18
  27. 2025OmniV2V: Versatile Video Generation and Editing via Dynamic Content Manipulationcited by 18
  28. 2026PISA: Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformerscited by 16
  29. 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Modelscited by 15
  30. 2023Catch-Up Distillation: You Only Need to Train Once for Accelerating Samplingcited by 13
  31. 2025Magic 1-For-1: Generating One Minute Video Clips within One Minutecited by 10
  32. 2026Optimizing Few-Step Generation with Adaptive Matching Distillationcited by 9
  33. 2026Efficient Video Diffusion Models: Advancements and Challengescited by 6
  34. 2026FastLightGen: Fast and Light Video Generation with Fewer Steps and Parameterscited by 4
  35. 2025LoVoRA: Text-guided and Mask-free Video Object Removal and Addition with Learnable Object-aware Localizationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.