# Generative Face Video Coding Techniques and Standardization Efforts: A Review

arXiv: https://arxiv.org/abs/2311.02649 · HTML: https://mlsanity.com/paper/2311.02649/

## Key facts

- Cited by 19 papers in the map (data through 14 Oct 2026).
- Builds on 17 of its 50 references that are in the map.
- First posted on arXiv 5 Nov 2023.

## Builds on (most cited first, 17 of 17)

- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Diffusion Models Beat GANs on Image Synthesis](https://mlsanity.com/paper/2105.05233/) (2021)
- [Image Quality Assessment: Unifying Structure and Texture Similarity](https://mlsanity.com/paper/2004.07728/) (2020)
- [VoxCeleb: a large-scale speaker identification dataset](https://mlsanity.com/paper/1706.08612/) (2017)
- [First Order Motion Model for Image Animation](https://mlsanity.com/paper/2003.00196/) (2020)
- [One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing](https://mlsanity.com/paper/2011.15126/) (2020)
- [Motion Representations for Articulated Animation](https://mlsanity.com/paper/2104.11280/) (2021)
- [Depth-Aware Generative Adversarial Network for Talking Head Video Generation](https://mlsanity.com/paper/2203.06605/) (2022)
- [Low Bandwidth Video-Chat Compression using Deep Generative Models](https://mlsanity.com/paper/2012.00328/) (2020)
- [Ultra-low bitrate video conferencing using deep image animation](https://mlsanity.com/paper/2012.00346/) (2020)
- [Interactive Face Video Coding: A Generative Compression Framework](https://mlsanity.com/paper/2302.09919/) (2023)
- [Perceptual Quality Assessment of Face Video Compression: A Benchmark and An Effective Method](https://mlsanity.com/paper/2304.07056/) (2023)
- [Neural Face Video Compression using Multiple Views](https://mlsanity.com/paper/2203.15401/) (2022)
- [Generative Compression for Face Video: A Hybrid Scheme](https://mlsanity.com/paper/2204.10055/) (2022)
- [Compressing Video Calls using Synthetic Talking Heads](https://mlsanity.com/paper/2210.03692/) (2022)
- [Predictive Coding For Animation-Based Video Compression](https://mlsanity.com/paper/2307.04187/) (2023)
- [A Hybrid Deep Animation Codec for Low-bitrate Video Conferencing](https://mlsanity.com/paper/2207.13530/) (2022)

## Built on by (most cited first, 19 of 19)

- [Generative Visual Compression: A Review](https://mlsanity.com/paper/2402.02140/) (2024)
- [M3-CVC: Controllable Video Compression with Multimodal Generative Models](https://mlsanity.com/paper/2411.15798/) (2024)
- [T-GVC: Trajectory-Guided Generative Video Coding at Ultra-Low Bitrates](https://mlsanity.com/paper/2507.07633/) (2025)
- [Beyond GFVC: A Progressive Face Video Compression Framework with Adaptive Visual Tokens](https://mlsanity.com/paper/2410.08485/) (2024)
- [Generative Human Video Compression with Multi-granularity Temporal Trajectory Factorization](https://mlsanity.com/paper/2410.10171/) (2024)
- [Conditional Video Generation for High-Efficiency Video Compression](https://mlsanity.com/paper/2507.15269/) (2025)
- [Standardizing Generative Face Video Compression using Supplemental Enhancement Information](https://mlsanity.com/paper/2410.15105/) (2024)
- [Tokenizing Motion: A Generative Approach for Scene Dynamics Compression](https://mlsanity.com/paper/2410.09768/) (2024)
- [Pleno-Generation: A Scalable Generative Face Video Compression Framework with Bandwidth Intelligence](https://mlsanity.com/paper/2502.17085/) (2025)
- [Generative Models at the Frontier of Compression: A Survey on Generative Face Video Coding](https://mlsanity.com/paper/2506.07369/) (2025)
- [Compressing Human Body Video with Interactive Semantics: A Generative Approach](https://mlsanity.com/paper/2505.16152/) (2025)
- [GaussianHeadTalk: Wobble-Free 3D Talking Heads with Audio Driven Gaussian Splatting](https://mlsanity.com/paper/2512.10939/) (2025)
- [Rethinking Generative Human Video Coding with Implicit Motion Transformation](https://mlsanity.com/paper/2506.10453/) (2025)
- [Sparse2Dense: A Keypoint-driven Generative Framework for Human Video Compression and Vertex Prediction](https://mlsanity.com/paper/2509.23169/) (2025)
- [Wireless Video Semantic Communication with Decoupled Diffusion Multi-frame Compensation](https://mlsanity.com/paper/2511.02478/) (2025)
- [ReGenVC: End-to-End Real-Time Generative Video Coding at Ultra-Low Bitrate](https://mlsanity.com/paper/2607.28144/) (2026)
- [A Lightweight Dual-Mode Optimization for Generative Face Video Coding](https://mlsanity.com/paper/2508.13547/) (2025)
- [Context Video Semantic Transmission with Variable Length and Rate Coding over MIMO Channels](https://mlsanity.com/paper/2601.06059/) (2025)
- [A Camera-Native Talking-Head Video Dataset for Various Computer Vision Tasks](https://mlsanity.com/paper/2603.26763/) (2026)

## Abstract (arXiv)

Generative Face Video Coding (GFVC) techniques can exploit the compact representation of facial priors and the strong inference capability of deep generative models, achieving high-quality face video communication in ultra-low bandwidth scenarios. This paper conducts a comprehensive survey on the recent advances of the GFVC techniques and standardization efforts, which could be applicable to ultra low bitrate communication, user-specified animation/filtering and metaverse-related functionalities. In particular, we generalize GFVC systems within one coding framework and summarize different GFVC algorithms with their corresponding visual representations. Moreover, we review the GFVC standardization activities that are specified with supplemental enhancement information messages. Finally, we discuss fundamental challenges and broad applications on GFVC techniques and their standardization potentials, as well as envision their future trends. The project page can be found at https://github.com/Berlin0610/Awesome-Generative-Face-Video-Coding.