mlsanityData to 14 Oct 2026

SynergyNet: Fusing Generative Priors and State-Space Models for Facial Beauty Prediction

arXiv 2509.17172 ↗First posted 21 Sep 2025cs.CVcited by 2

On the map: State-space sequence models (S4, Mamba) → Vision Mamba backbones

Abstract (arXiv)

The automated prediction of facial beauty is a benchmark task in affective computing that requires a sophisticated understanding of both local aesthetic details (e.g., skin texture) and global facial harmony (e.g., symmetry, proportions). Existing models, based on either Convolutional Neural Networks (CNNs) or Vision Transformers (ViTs), exhibit inherent architectural biases that limit their performance; CNNs excel at local feature extraction but struggle with long-range dependencies, while ViTs model global relationships at a significant computational cost. This paper introduces the Mamba-Diffusion Network (MD-Net), a novel dual-stream architecture that resolves this trade-off by delegating specialized roles to state-of-the-art models. The first stream leverages a frozen U-Net encoder from a pre-trained latent diffusion model, providing a powerful generative prior for fine-grained aesthetic qualities. The second stream employs a Vision Mamba (Vim), a modern state-space model, to efficiently capture global facial structure with linear-time complexity. By synergistically integrating these complementary representations through a cross-attention mechanism, MD-Net creates a holistic and nuanced feature space for prediction. Evaluated on the SCUT-FBP5500 benchmark, MD-Net sets a new state-of-the-art, achieving a Pearson Correlation of 0.9235 and demonstrating the significant potential of hybrid architectures that fuse generative and sequential modeling paradigms for complex visual assessment tasks.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Vision Mamba backbones, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 11 of its 34 references that are in the map. First posted on arXiv 21 Sep 2025.

Builds on

11 of 34 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Mamba-CNN: A Hybrid Architecture for Efficient and Accurate Facial Beauty Prediction1 Sep
  2. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model17 Jan

Other references · 9

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2015An Introduction to Convolutional Neural Networkscited by 514
  6. 2018SCUT-FBP5500: A Diverse Benchmark Dataset for Multi-Paradigm Facial Beauty Predictioncited by 33
  7. 2016Label distribution based facial attractiveness computation by deep residual learningcited by 12
  8. 2025Generative Pre-training for Subjective Tasks: A Diffusion Transformer-Based Framework for Facial Beauty Predictioncited by 4
  9. 2025Scale-interaction transformer: a hybrid cnn-transformer model for facial beauty predictioncited by 3

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AttriCtrl: Fine-Grained Control of Aesthetic Attribute Intensity in Diffusion Models
  2. 2026AccelAes: Accelerating Diffusion Transformers for Training-Free Aesthetic-Enhanced Image Generation
  3. 2020A Deep Drift-Diffusion Model for Image Aesthetic Score Distribution Prediction
  4. 2026Supervised makeup transfer with a curated dataset: Decoupling identity and makeup features for enhanced transformation
  5. 2024Mamba-ST: State Space Model for Efficient Style Transfer
  6. 2025Multivariate Diffusion Transformer with Decoupled Attention for High-Fidelity Mask-Text Collaborative Facial Generation
  7. 2024SHMT: Self-supervised Hierarchical Makeup Transfer via Latent Diffusion Models
  8. 2026BeautyGRPO: Aesthetic Alignment for Face Retouching via Dynamic Path Guidance and Fine-Grained Preference Modeling