mlsanityData to 14 Oct 2026

FaSDiff: Balancing Perception and Semantics in Face Compression via Stable Diffusion Priors

arXiv 2505.05870 ↗First posted 9 May 2025cs.CV cs.AI eess.IVcited by 0

On the map: Diffusion models → Diffusion for compression and wireless

Abstract (arXiv)

With the increasing deployment of facial image data across a wide range of applications, efficient compression tailored to facial semantics has become critical for both storage and transmission. While recent learning-based face image compression methods have achieved promising results, they often suffer from degraded reconstruction quality at low bit rates. Directly applying diffusion-based generative priors to this task leads to suboptimal performance in downstream machine vision tasks, primarily due to poor preservation of high-frequency details. In this work, we propose FaSDiff (Facial Image Compression with a Stable Diffusion Prior), a novel diffusion-driven compression framework designed to enhance both visual fidelity and semantic consistency. FaSDiff incorporates a high-frequency-sensitive compressor to capture fine-grained details and generate robust visual prompts for guiding the diffusion model. To address low-frequency degradation, we further introduce a hybrid low-frequency enhancement module that disentangles and preserves semantic structures, enabling stable modulation of the diffusion prior during reconstruction. By jointly optimizing perceptual quality and semantic preservation, FaSDiff effectively balances human visual fidelity and machine vision accuracy. Extensive experiments demonstrate that FaSDiff outperforms state-of-the-art methods in both perceptual metrics and downstream task performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion for compression and wireless, one of 14 directions in Diffusion models. Builds on 35 of its 53 references that are in the map. First posted on arXiv 9 May 2025.

Builds on

35 of 53 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Lossy Compression with Pretrained Diffusion Models16 Jan
  2. 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Prior29 Apr
  3. 2024Lossy Image Compression with Foundation Diffusion Models12 Apr
  4. 2022Lossy Image Compression with Conditional Diffusion Models14 Sep
  5. 2022Lossy Compression with Gaussian Diffusion17 Jun

Other references · 30

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  9. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  10. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  11. 2018Variational image compression with a scale hyperpriorcited by 935
  12. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
18 more
  1. 2016End-to-end Optimized Image Compressioncited by 696
  2. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
  3. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 590
  4. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  5. 2020High-Fidelity Generative Image Compressioncited by 338
  6. 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 301
  7. 2023FreeU: Free Lunch in Diffusion U-Netcited by 196
  8. 2019Adaptive Wing Loss for Robust Face Alignment via Heatmap Regressioncited by 128
  9. 2017A Review on Deep Learning Techniques Applied to Semantic Segmentationcited by 122
  10. 2023Towards image compression with perfect realism at ultra-low bitratescited by 103
  11. 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 94
  12. 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 58
  13. 2023Frequency-Aware Transformer for Learned Image Compressioncited by 58
  14. 2025MambaIC: State Space Models for High-Performance Learned Image Compressioncited by 20
  15. 2023Scalable Face Image Coding via StyleGAN Prior: Towards Compression for Human-Machine Collaborative Visioncited by 11
  16. 2025Conditional Latent Coding with Learnable Synthesized Reference for Deep Image Compressioncited by 11
  17. 2019Scalable Facial Image Compression with Deep Feature Reconstructioncited by 8
  18. 2024FaceScore: Benchmarking and Enhancing Face Quality in Human Generationcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards Efficient Low-rate Image Compression with Frequency-aware Diffusion Prior Refinement
  2. 2025Generative Preprocessing for Image Compression with Pre-trained Diffusion Models
  3. 2024Diffusion Prior Interpolation for Flexibility Real-World Face Super-Resolution
  4. 2025Diff-ICMH: Harmonizing Machine and Human Vision in Image Compression with Generative Prior
  5. 2023FLAIR: A Conditional Diffusion Framework with Applications to Face Video Restoration
  6. 2025LAFR: Efficient Diffusion-based Blind Face Restoration via Latent Codebook Alignment Adapter
  7. 2025Ultra Lowrate Image Compression with Semantic Residual Coding and Compression-aware Diffusion
  8. 2025Generative Image Coding with Diffusion Prior