Reinforcement-Guided Synthetic Data Generation for Privacy-Sensitive Identity Recognition
Not on the map. Why?
Abstract (arXiv)
High-fidelity generative models are increasingly needed in privacy-sensitive scenarios, where access to data is severely restricted due to regulatory and copyright constraints. This scarcity hampers model development--ironically, in settings where generative models are most needed to compensate for the lack of data. This creates a self-reinforcing challenge: limited data leads to poor generative models, which in turn fail to mitigate data scarcity. To break this cycle, we propose a reinforcement-guided synthetic data generation framework that adapts general-domain generative priors to privacy-sensitive identity recognition tasks. We first perform a cold-start adaptation to align a pretrained generator with the target domain, establishing semantic relevance and initial fidelity. Building on this foundation, we introduce a multi-objective reward that jointly optimizes semantic consistency, coverage diversity, and expression richness, guiding the generator to produce both realistic and task-effective samples. During downstream training, a dynamic sample selection mechanism further prioritizes high-utility synthetic samples, enabling adaptive data scaling and improved domain alignment. Extensive experiments on benchmark datasets demonstrate that our framework significantly improves both generation fidelity and classification accuracy, while also exhibiting strong generalization to novel categories in small-data regimes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 62 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
39 of 62 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2017Random Erasing Data Augmentationcited by 1,235
27 more
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2014Learning Face Representation from Scratchcited by 451
- 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 431
- 2017Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environmentscited by 258
- 2015Generative Moment Matching Networkscited by 252
- 2019Joint Discriminative and Generative Learning for Person Re-identificationcited by 211
- 2019A Strong Baseline and Batch Normalization Neck for Deep Person Re-identificationcited by 154
- 2022Minimizing the Accumulated Trajectory Error to Improve Dataset Distillationcited by 142
- 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Modelscited by 116
- 2018Dissecting Person Re-identification from the Viewpoint of Viewpointcited by 83
- 2023IDiff-Face: Synthetic-based Face Recognition through Fizzy Identity-Conditioned Diffusion Modelscited by 72
- 2022SFace: Privacy-friendly and Accurate Face Recognition using Synthetic Datacited by 63
- 2022Expanding Small-Scale Datasets with Guided Imaginationcited by 61
- 2024Diversity-Driven Synthesis: Enhancing Dataset Distillation through Directed Weight Adjustmentcited by 32
- 2023Identity-driven Three-Player Generative Adversarial Network for Synthetic-based Face Recognitioncited by 27
- 2021Less is More: Learning from Synthetic Data with Fine-grained Attributes for Person Re-Identificationcited by 19
- 2022Refined Semantic Enhancement towards Frequency Diffusion for Video Captioningcited by 18
- 2024Advancing Text-Driven Chest X-Ray Generation with Policy-Based Reinforcement Learningcited by 10
- 2024Synthesizing Efficient Data with Diffusion Models for Person Re-Identification Pre-Trainingcited by 10
- 2025Scone: Bridging Composition and Distinction in Subject-Driven Image Generation via Unified Understanding-Generation Modelingcited by 10
- 2016Doubly Stochastic Neighbor Embedding on Spherescited by 9
- 2018Racial Faces in-the-Wild: Reducing Racial Bias by Information Maximization Adaptation Networkcited by 7
- 2025RL4Med-DDPO: Reinforcement Learning for Controlled Guidance Towards Diverse Medical Image Generation using Vision-Language Foundation Modelscited by 5
- 2022A Benchmark of Video-Based Clothes-Changing Person Re-Identificationcited by 4
- 2025NegFaceDiff: The Power of Negative Context in Identity-Conditioned Diffusion for Synthetic Face Generationcited by 3
Built on by
Not cited yet.