UniComp: Rethinking Video Compression Through Informational Uniqueness
Not on the map. Why?
Abstract (arXiv)
Distinct from attention-based compression methods, this paper presents an information uniqueness driven video compression framework, termed UniComp, which aims to maximize the information fidelity of video representations under constrained computational budgets. Starting from the information-theoretic perspective, we formulate the vision compression as an optimization problem that minimizes conditional entropy (reconstruction error) between retained and full tokens. To achieve this, we introduce the notion of information uniqueness to measure intrinsic redundancy among tokens to link with reconstruction error. Based on uniqueness, we design three modules-Frame Group Fusion, Token Allocation, and Spatial Dynamic Compression-that progressively perform semantic frame grouping, adaptive resource allocation, and fine-grained spatial compression. Extensive experiments demonstrate that UniComp consistently outperforms existing compression methods in preserving essential visual tokens under limited computational budgets, highlighting the pivotal role of information uniqueness in token compression efficacy.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 41 of its 46 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
41 of 46 references.
References · 41
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
- 2022Token Merging: Your ViT But Fastercited by 995
- 2023VILA: On Pre-training for Visual Language Modelscited by 686
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 629
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
- 2023LLaMA-VID: An Image is Worth 2 Tokens in Large Language Modelscited by 539
29 more
- 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
- 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 378
- 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 368
- 2025Seed1.5-VL Technical Reportcited by 367
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 344
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
- 2024VisionZip: Longer is Better but Not Necessary in Vision Language Modelscited by 298
- 2024PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reductioncited by 283
- 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 275
- 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
- 2022Zero-Shot Video Question Answering via Frozen Bidirectional Language Modelscited by 229
- 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
- 2025MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttrainingcited by 117
- 2023VideoLLM: Modeling Video Sequence with Large Language Modelscited by 116
- 2024DyCoke: Dynamic Compression of Tokens for Fast Video Large Language Modelscited by 93
- 2023Audio-Visual LLM for Video Understandingcited by 76
- 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 69
- 2024Number it: Temporal Grounding Videos like Flipping Mangacited by 65
- 2024PruneVid: Visual Token Pruning for Efficient Video Large Language Modelscited by 64
- 2025Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Modelscited by 62
- 2025HoliTom: Holistic Token Merging for Fast Video Large Language Modelscited by 58
- 2024FrameFusion: Combining Similarity and Importance for Video Token Reduction on Large Vision Language Modelscited by 52
- 2025FastVID: Dynamic Density Pruning for Fast Video Large Language Modelscited by 47
- 2025Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracycited by 39
- 2025Video Compression Commander: Plug-and-Play Inference Acceleration for Video Large Language Modelscited by 38
- 2023VLAB: Enhancing Video Language Pre-training by Feature Adapting and Blendingcited by 17
- 2025DATE: Dynamic Absolute Time Enhancement for Long Video Understandingcited by 9
- 2024Fewer Tokens and Fewer Videos: Extending Video Understanding Abilities in Large Vision-Language Modelscited by 6
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026When Shared Knowledge Hurts: Spectral Over-Accumulation in Model Mergingcited by 5
- 2026V-CAST: Video Curvature-Aware Spatio-Temporal Pruning for Efficient Video Large Language Modelscited by 2
- 2026Deferred Audio Pruning with Local Audio-Visual Dynamics for Omni-LLMscited by 2
- 2026EchoPrune: Interpreting Redundancy as Temporal Echoes for Efficient VideoLLMscited by 1
- 2026OTT-Vid: Optimal Transport Temporal Token Compression for Video Large Language Modelscited by 1
- 2026Swift Sampling: Selecting Temporal Surprises via Taylor Seriescited by 1
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMscited by 1
- 2026Deferred Audio Pruning with Local Audio-Visual Dynamics for Omni-LLMs9 Aug 2026
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs14 Jul 2026
- 2026Swift Sampling: Selecting Temporal Surprises via Taylor Series21 May 2026
- 2026OTT-Vid: Optimal Transport Temporal Token Compression for Video Large Language Models12 May 2026
- 2026EchoPrune: Interpreting Redundancy as Temporal Echoes for Efficient VideoLLMs11 May 2026
- 2026V-CAST: Video Curvature-Aware Spatio-Temporal Pruning for Efficient Video Large Language Models29 Mar 2026
- 2026When Shared Knowledge Hurts: Spectral Over-Accumulation in Model Merging5 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026CRAFT: Compression via Recursive Adaptive Fusion of Video Tokens for Vision-Language Models
- 2026Rethinking Video Token Compression with a Global Codebook: Learning Once, Compressing Everywhere
- 2026Compression Tells Intelligence: Visual Coding, Visual Token Technology, and the Unification
- 2026Prune Redundancy, Preserve Essence: Vision Token Compression in VLMs via Synergistic Importance-Diversity
- 2026Compression as Adaptation: Implicit Visual Representation with Diffusion Foundation Models
- 2024PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models
- 2026InfoMerge: Information-aware Token Compression for Efficient Video Large Language Models
- 2026UniCompress: Token Compression for Unified Vision-Language Understanding and Generation