Flash-Unified: A Training-Free and Task-Aware Acceleration Framework for Native Unified Models
On the map: Efficient LLM inference and serving → Visual token pruning in multimodal models
Abstract (arXiv)
Native unified multimodal models, which integrate both generative and understanding capabilities, face substantial computational overhead that hinders their real-world deployment. Existing acceleration techniques typically employ a static, monolithic strategy, ignoring the fundamental divergence in computational profiles between iterative generation tasks (e.g., image generation) and single-pass understanding tasks (e.g., VQA). In this work, we present the first systematic analysis of unified models, revealing pronounced parameter specialization, where distinct neuron sets are critical for each task. This implies that, at the parameter level, unified models have implicitly internalized separate inference pathways for generation and understanding within a single architecture. Based on these insights, we introduce a training-free and task-aware acceleration framework, FlashU, that tailors optimization to each task's demands. Across both tasks, we introduce Task-Specific Network Pruning and Dynamic Layer Skipping, aiming to eliminate inter-layer and task-specific redundancy. For visual generation, we implement a time-varying control signal for the guidance scale and a temporal approximation for the diffusion head via Diffusion Head Cache. For multimodal understanding, building upon the pruned model, we introduce Dynamic Token Pruning via a V-Norm Proxy to exploit the spatial redundancy of visual inputs. Extensive experiments on Show-o2 demonstrate that FlashU achieves 1.78× to 2.01× inference acceleration across both understanding and generation tasks while maintaining SOTA performance, outperforming competing unified models and validating our task-aware acceleration paradigm. Our code is publicly available at https://github.com/Rirayh/FlashU.
Key facts. Cited by 5 papers in the map (data through 13 Oct 2026). Placed in Visual token pruning in multimodal models, one of 12 directions in Efficient LLM inference and serving. First posted on arXiv 16 Mar 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computingcited by 6
- 2026EvoStreaming: Your Offline Video Model Is a Natively Streaming Assistantcited by 5
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialoguecited by 2
- 2026Accelerating Unified Multimodal Models with Core-Expansion Routing and Unified Computation Schedulingcited by 0
- 2026UniCache: Task- and Type-Aware KV Cache Compression for Unified Multimodal Modelscited by 0
- 2026UniCache: Task- and Type-Aware KV Cache Compression for Unified Multimodal Models26 Sep 2026
- 2026Accelerating Unified Multimodal Models with Core-Expansion Routing and Unified Computation Scheduling29 Aug 2026
- 2026OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computing14 Jun 2026
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialogue19 May 2026
- 2026EvoStreaming: Your Offline Video Model Is a Natively Streaming Assistant11 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026UniG2U-Bench: Do Unified Models Advance Multimodal Understanding?
- 2025Understanding and Harnessing Sparsity in Unified Multimodal Models
- 2026UniRect-CoT: Enhancing Generation in Unified Multimodal Models via Reflective Rectification with Inherent Understanding
- 2025UniModel: A Visual-Only Framework for Unified Multimodal Understanding and Generation
- 2025Emu3.5: Native Multimodal Models are World Learners
- 2025ParaUni: Enhance Generation in Unified Multimodal Model with Reinforcement-driven Hierarchical Parallel Information Interaction
- 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark
- 2026On the Limits of Token Reduction for Efficient Unified Vision Language Training