mlsanityData to 14 Oct 2026

Towards Anatomically Plausible Human Image Generation via Synthetic Localized Preferences

arXiv 2605.25759 ↗First posted 25 May 2026cs.CVcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Large-scale text-to-image foundation models have achieved remarkable visual realism, yet generating human images with correct anatomical structures remains challenging. Existing approaches enforce anatomical constraints through part-specific modules or localized loss weighting during supervised fine-tuning on high-quality human photos, but such datasets are limited and often provide ambiguous optimization signals due to confounding factors such as lighting, pose, and background. Preference-based alignment offers an alternative, but standard Direct Preference Optimization (DPO) treats all pixels equally and therefore fails to exploit the localized nature of anatomical artifacts. To address this, we propose the framework of Alignment via Synthetic Anatomical Preference (ASAP), which constructs controlled preference pairs through a localized degradation mechanism applied to high-fidelity human images. This mechanism performs a controlled experiment on images by introducing explicit anatomical errors in targeted regions while preserving the remaining content. With this mechanism, we create the Human Anatomical Preference (HAP) dataset with over 10K curated pairs for effective anatomical alignment of text-to-image human image generative models. To better leverage the locality of these controlled preference pairs, we introduce a localized and margin-bounded variant of DPO that prioritizes optimization in targeted anatomical regions while enforcing a finite preference margin to prevent over-optimization and preserve global semantics. We further introduce HAF-Bench, a benchmark for systematic evaluation of anatomical fidelity. Extensive experiments demonstrate that ASAP consistently reduces anatomical errors across multiple foundation models while maintaining overall image quality.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 43 of its 46 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

43 of 46 references.

Closest ancestors · 10

Same direction, newest first

  1. 2026Learning from Noisy Preferences: A Semi-Supervised Learning Approach to Direct Preference Optimization27 Apr
  2. 2025HPSv3: Towards Wide-Spectrum Human Preference Score5 Aug
  3. 2025D-Fusion: Direct Preference Optimization for Aligning Diffusion Models with Visually Consistent Samples28 May
  4. 2025Harness Local Rewards for Global Benefits: Effective Text-to-Video Generation Alignment with Patch-level Reward Models4 Feb
  5. 2025Dual-IPO: Dual-Iterative Preference Optimization for Text-to-Video Generation4 Feb
  6. 2025Focus-N-Fix: Region-Aware Fine-Tuning for Text-to-Image Generation11 Jan
  7. 2024Boost Your Human Image Generation Model via Direct Preference Optimization30 May
  8. 2023Rich Human Feedback for Text-to-Image Generation15 Dec
  9. 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov
  10. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preference25 Mar

Other references · 33

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  8. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  9. 2022Flow Matching for Generative Modelingcited by 5,702
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
21 more
  1. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  3. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  4. 2025Qwen-Image Technical Reportcited by 1,044
  5. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  6. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  7. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 912
  8. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  9. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
  10. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
  11. 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 105
  12. 2023HyperHuman: Hyper-Realistic Human Generation with Latent Structural Diffusioncited by 68
  13. 2024CosmicMan: A Text-to-Image Foundation Model for Humanscited by 30
  14. 2024HumanRefiner: Benchmarking Abnormal Human Generation and Refining with Coarse-to-fine Pose-Reversible Guidancecited by 25
  15. 2024PatchDPO: Patch-level DPO for Finetuning-free Personalized Image Generationcited by 18
  16. 2024Towards Effective Usage of Human-Centric Priors in Diffusion Models for Text-based Human Image Generationcited by 17
  17. 2024MoLE: Enhancing Human-centric Text-to-image Diffusion via Mixture of Low-rank Expertscited by 15
  18. 2022Human Image Generation: A Comprehensive Surveycited by 11
  19. 2024RealisHuman: A Two-Stage Approach for Refining Malformed Human Parts in Generated Imagescited by 10
  20. 2025MR-FlowDPO: Multi-Reward Direct Preference Optimization for Flow-Matching Text-to-Music Generationcited by 5
  21. 2025FairHuman: Boosting Hand and Face Quality in Human Image Generation with Minimum Potential Delay Fairness in Diffusion Modelscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025What Makes a Good Generated Image? Investigating Human and Multimodal LLM Image Preference Alignment
  2. 2025Enhancing Reward Models for High-quality Image Generation: Beyond Text-Image Alignment
  3. 2026Threshold-Guided Optimization for Visual Generative Models
  4. 2024Synth-Align: Improving Trustworthiness in Vision-Language Model with Synthetic Preference Data Alignment
  5. 2024Multimodal Large Language Model is a Human-Aligned Annotator for Text-to-Image Generation
  6. 2026Analyzing and Improving Fine-grained Preference Optimization in Medical LVLMs
  7. 2025OSPO: Object-Centric Self-Improving Preference Optimization for Text-to-Image Generation
  8. 2025InstructEngine: Instruction-driven Text-to-Image Alignment