mlsanityData to 14 Oct 2026

Resi-VidTok: An Efficient and Decomposed Progressive Tokenization Framework for Ultra-Low-Rate and Lightweight Video Transmission

arXiv 2510.25002 ↗First posted 28 Oct 2025cs.IT cs.CV cs.MMcited by 1

Not on the map. Why?

Abstract (arXiv)

Real-time transmission of video over wireless networks remains highly challenging, even with advanced deep models, particularly under severe channel conditions such as limited bandwidth and weak connectivity. In this paper, we propose Resi-VidTok, a Resilient Tokenization-Enabled framework designed for ultra-low-rate and lightweight video transmission that delivers strong robustness while preserving perceptual and semantic fidelity on commodity digital hardware. By reorganizing spatio--temporal content into a discrete, importance-ordered token stream composed of key tokens and refinement tokens, Resi-VidTok enables progressive encoding, prefix-decodable reconstruction, and graceful quality degradation under constrained channels. A key contribution is a resilient 1D tokenization pipeline for video that integrates differential temporal token coding, explicitly supporting reliable recovery from incomplete token sets using a single shared framewise decoder--without auxiliary temporal extractors or heavy generative models. Furthermore, stride-controlled frame sparsification combined with a lightweight decoder-side interpolator reduces transmission load while maintaining motion continuity. Finally, a channel-adaptive source--channel coding and modulation scheme dynamically allocates rate and protection according to token importance and channel condition, yielding stable quality across adverse SNRs. Evaluation results indicate robust visual and semantic consistency at channel bandwidth ratios (CBR) as low as 0.0004 and real-time reconstruction at over 30 fps, demonstrating the practicality of Resi-VidTok for energy-efficient, latency-sensitive, and reliability-critical wireless applications.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 18 references that are in the map. First posted on arXiv 28 Oct 2025.

Builds on

11 of 18 references.

References · 11

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  3. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  4. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  5. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  6. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
  7. 2022Wireless Deep Video Semantic Transmissioncited by 50
  8. 2021DeepWiVe: Deep-Learning-Aided Wireless Video Transmissioncited by 45
  9. 2022DeepJSCC-Q: Constellation Constrained Deep Joint Source-Channel Codingcited by 38
  10. 2025Generative Video Semantic Communication via Multimodal Semantic Fusion with Large Modelcited by 9
  11. 2025ResiTok: A Resilient Tokenization-Enabled Framework for Ultra-Low-Rate and Robust Image Transmissioncited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.