Ultra-low bitrate video conferencing using deep image animation
Not on the map. Why?
Abstract (arXiv)
In this work we propose a novel deep learning approach for ultra-low bitrate video compression for video conferencing applications. To address the shortcomings of current video compression paradigms when the available bandwidth is extremely limited, we adopt a model-based approach that employs deep neural networks to encode motion information as keypoint displacement and reconstruct the video signal at the decoder side. The overall system is trained in an end-to-end fashion minimizing a reconstruction error on the encoder output. Objective and subjective quality evaluation experiments demonstrate that the proposed approach provides an average bitrate reduction for the same visual quality of more than 80% compared to HEVC.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 8; 2025: 7; 2026: 2.
22 papers.
Sort:
By area:
- 2023Generative Face Video Coding Techniques and Standardization Efforts: A Reviewcited by 19
- 2023Interactive Face Video Coding: A Generative Compression Frameworkcited by 17
- 2024Generative Visual Compression: A Reviewcited by 13
- 2022Neural Face Video Compression using Multiple Viewscited by 11
- 2023Predictive Coding For Animation-Based Video Compressioncited by 9
- 2024M3-CVC: Controllable Video Compression with Multimodal Generative Modelscited by 9
- 2024Beyond GFVC: A Progressive Face Video Compression Framework with Adaptive Visual Tokenscited by 7
- 2024Generative Human Video Compression with Multi-granularity Temporal Trajectory Factorizationcited by 5
- 2024Standardizing Generative Face Video Compression using Supplemental Enhancement Informationcited by 4
- 2024Tokenizing Motion: A Generative Approach for Scene Dynamics Compressioncited by 3
- 2025Pleno-Generation: A Scalable Generative Face Video Compression Framework with Bandwidth Intelligencecited by 3
- 2025Generative Models at the Frontier of Compression: A Survey on Generative Face Video Codingcited by 3
10 more
- 2024Survey on Visual Signal Coding and Processing with Generative Models: Technologies, Standards and Optimizationcited by 2
- 2025Bidirectional Learned Facial Animation Codec for Low Bitrate Talking Head Videoscited by 2
- 2025Compressing Human Body Video with Interactive Semantics: A Generative Approachcited by 2
- 2022Efficient conditioned face animation using frontally-viewed embeddingcited by 1
- 2025Rethinking Generative Human Video Coding with Implicit Motion Transformationcited by 1
- 2024Resolution-Agnostic Neural Compression for High-Fidelity Portrait Video Conferencing via Implicit Radiance Fieldscited by 0
- 2025Audio-Visual Driven Compression for Low-Bitrate Talking Head Videoscited by 0
- 2025Revising Second Order Terms in Deep Animation Video Codingcited by 0
- 2026A Causal Diffusion Model for Video Reconstruction from Ultra-Low-Bitrate Representationscited by 0
- 2026Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusioncited by 0
- 2026Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusion4 May 2026
- 2026A Causal Diffusion Model for Video Reconstruction from Ultra-Low-Bitrate Representations14 Feb 2026
- 2025Revising Second Order Terms in Deep Animation Video Coding27 Oct 2025
- 2025Audio-Visual Driven Compression for Low-Bitrate Talking Head Videos16 Jun 2025
- 2025Rethinking Generative Human Video Coding with Implicit Motion Transformation12 Jun 2025
- 2025Generative Models at the Frontier of Compression: A Survey on Generative Face Video Coding9 Jun 2025
- 2025Compressing Human Body Video with Interactive Semantics: A Generative Approach22 May 2025
- 2025Bidirectional Learned Facial Animation Codec for Low Bitrate Talking Head Videos12 Mar 2025
- 2025Pleno-Generation: A Scalable Generative Face Video Compression Framework with Bandwidth Intelligence24 Feb 2025
- 2024M3-CVC: Controllable Video Compression with Multimodal Generative Models24 Nov 2024
- 2024Standardizing Generative Face Video Compression using Supplemental Enhancement Information19 Oct 2024
- 2024Generative Human Video Compression with Multi-granularity Temporal Trajectory Factorization14 Oct 2024
10 more
- 2024Tokenizing Motion: A Generative Approach for Scene Dynamics Compression13 Oct 2024
- 2024Beyond GFVC: A Progressive Face Video Compression Framework with Adaptive Visual Tokens11 Oct 2024
- 2024Survey on Visual Signal Coding and Processing with Generative Models: Technologies, Standards and Optimization23 May 2024
- 2024Resolution-Agnostic Neural Compression for High-Fidelity Portrait Video Conferencing via Implicit Radiance Fields26 Feb 2024
- 2024Generative Visual Compression: A Review3 Feb 2024
- 2023Generative Face Video Coding Techniques and Standardization Efforts: A Review5 Nov 2023
- 2023Predictive Coding For Animation-Based Video Compression9 Jul 2023
- 2023Interactive Face Video Coding: A Generative Compression Framework20 Feb 2023
- 2022Neural Face Video Compression using Multiple Views29 Mar 2022
- 2022Efficient conditioned face animation using frontally-viewed embedding16 Mar 2022
- 2023Generative Face Video Coding Techniques and Standardization Efforts: A Reviewcited by 19
- 2023Interactive Face Video Coding: A Generative Compression Frameworkcited by 17
- 2024Generative Visual Compression: A Reviewcited by 13
- 2022Neural Face Video Compression using Multiple Viewscited by 11
- 2023Predictive Coding For Animation-Based Video Compressioncited by 9
- 2024M3-CVC: Controllable Video Compression with Multimodal Generative Modelscited by 9
- 2024Beyond GFVC: A Progressive Face Video Compression Framework with Adaptive Visual Tokenscited by 7
- 2024Generative Human Video Compression with Multi-granularity Temporal Trajectory Factorizationcited by 5
- 2024Standardizing Generative Face Video Compression using Supplemental Enhancement Informationcited by 4
- 2024Tokenizing Motion: A Generative Approach for Scene Dynamics Compressioncited by 3
- 2025Pleno-Generation: A Scalable Generative Face Video Compression Framework with Bandwidth Intelligencecited by 3
- 2025Generative Models at the Frontier of Compression: A Survey on Generative Face Video Codingcited by 3
12 most cited of 20 All 20 (JSON)
- 2025Revising Second Order Terms in Deep Animation Video Coding27 Oct 2025
- 2025Audio-Visual Driven Compression for Low-Bitrate Talking Head Videos16 Jun 2025
- 2025Rethinking Generative Human Video Coding with Implicit Motion Transformation12 Jun 2025
- 2025Generative Models at the Frontier of Compression: A Survey on Generative Face Video Coding9 Jun 2025
- 2025Compressing Human Body Video with Interactive Semantics: A Generative Approach22 May 2025
- 2025Bidirectional Learned Facial Animation Codec for Low Bitrate Talking Head Videos12 Mar 2025
- 2025Pleno-Generation: A Scalable Generative Face Video Compression Framework with Bandwidth Intelligence24 Feb 2025
- 2024M3-CVC: Controllable Video Compression with Multimodal Generative Models24 Nov 2024
- 2024Standardizing Generative Face Video Compression using Supplemental Enhancement Information19 Oct 2024
- 2024Generative Human Video Compression with Multi-granularity Temporal Trajectory Factorization14 Oct 2024
- 2024Tokenizing Motion: A Generative Approach for Scene Dynamics Compression13 Oct 2024
- 2024Beyond GFVC: A Progressive Face Video Compression Framework with Adaptive Visual Tokens11 Oct 2024
12 newest of 20 All 20 (JSON)