LIVEditor-14B: Lightning Unified Video Editing via In-Context Sparse Attention
Not on the map. Why?
Abstract (arXiv)
Video editing has evolved toward In-Context Learning (ICL) paradigms, yet the resulting quadratic attention costs create a critical computational bottleneck. In this work, we propose In-context Sparse Attention (ISA), the first near-lossless empirical sparse framework tailored for ICL video editing. Our design is grounded in two key insights: first, context tokens exhibit significantly lower saliency than source tokens; second, we theoretically prove and empirically validate that Query sharpness correlates with approximation error. Motivated by these findings, ISA implements an efficient pre-selection strategy to prune redundant context, followed by a dynamic query grouping mechanism that routes high-error queries to full attention and low-error ones to a computationally efficient 0-th order Taylor sparse attention. Furthermore, we build textbftextttLIVEditor-14B , a novel lightning video editing model via ISA and a proposed video-editing data pipeline that curated a 1.7M high-quality dataset. Extensive experiments demonstrate that LIVEditor-14B achieves a ~60% reduction in attention-module latency while surpassing state-of-the-art methods across EditVerseBench, IVE-Bench, and VIE-Bench, delivering near-lossless acceleration without compromising visual fidelity.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 47 of its 52 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
47 of 52 references.
References · 47
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 414
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 200
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
35 more
- 2025HunyuanVideo 1.5 Technical Reportcited by 148
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
- 2025Fast Video Generation with Sliding Tile Attentioncited by 123
- 2025SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inferencecited by 113
- 2025VSA: Faster Video Diffusion with Trainable Sparse Attentioncited by 100
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
- 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
- 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 79
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
- 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 73
- 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
- 2025UNIC: Unified In-Context Video Editingcited by 53
- 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 53
- 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 49
- 2025TileLang: A Composable Tiled Programming Model for AI Systemscited by 42
- 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 42
- 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generationcited by 39
- 2024Alignment of Diffusion Models: Fundamentals, Challenges, and Futurecited by 34
- 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 34
- 2025InstructX: Towards Unified Visual Editing with MLLM Guidancecited by 31
- 2025IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessmentcited by 27
- 2024StableV2V: Stablizing Shape Consistency in Video-to-Video Editingcited by 25
- 2025Region-Constraint In-Context Generation for Instructional Video Editingcited by 22
- 2024Video Diffusion Models are Strong Video Inpaintercited by 21
- 2025Sliding Window Attention Training for Efficient Large Language Modelscited by 21
- 2025MagicDistillation: Weak-to-Strong Video Distillation for Large-Scale Few-Step Synthesiscited by 18
- 2025OmniV2V: Versatile Video Generation and Editing via Dynamic Content Manipulationcited by 18
- 2026PISA: Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformerscited by 16
- 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Modelscited by 15
- 2023Catch-Up Distillation: You Only Need to Train Once for Accelerating Samplingcited by 13
- 2025Magic 1-For-1: Generating One Minute Video Clips within One Minutecited by 10
- 2026Optimizing Few-Step Generation with Adaptive Matching Distillationcited by 9
- 2026Efficient Video Diffusion Models: Advancements and Challengescited by 6
- 2026FastLightGen: Fast and Light Video Generation with Fewer Steps and Parameterscited by 4
- 2025LoVoRA: Text-guided and Mask-free Video Object Removal and Addition with Learnable Object-aware Localizationcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.