mlsanityData to 7 Oct 2026

PainDiffusion: Learning to Express Pain

arXiv 2409.11635 ↗First posted 18 Sep 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate pain expression synthesis is essential for improving clinical training and human-robot interaction. Current Robotic Patient Simulators (RPSs) lack realistic pain facial expressions, limiting their effectiveness in medical training. In this work, we introduce PainDiffusion, a generative model that synthesizes naturalistic facial pain expressions. Unlike traditional heuristic or autoregressive methods, PainDiffusion operates in a continuous latent space, ensuring smoother and more natural facial motion while supporting indefinite-length generation via diffusion forcing. Our approach incorporates intrinsic characteristics such as pain expressiveness and emotion, allowing for personalized and controllable pain expression synthesis. We train and evaluate our model using the BioVid HeatPain Database. Additionally, we integrate PainDiffusion into a robotic system to assess its applicability in real-time rehabilitation exercises. Qualitative studies with clinicians reveal that PainDiffusion produces realistic pain expressions, with a 31.2% (std 4.8%) preference rate against ground-truth recordings. Our results suggest that PainDiffusion can serve as a viable alternative to real patients in clinical training and simulation, bridging the gap between synthetic and naturalistic pain expression. Code and videos are available at: https://damtien444.github.io/paindf/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 18 Sep 2024.

Builds on

22 of 40 references.

References · 22

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2022Classifier-Free Diffusion Guidancecited by 5,717
  5. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  6. 2022Video Diffusion Modelscited by 2,280
  7. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  8. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  9. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  10. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  11. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  12. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
10 more
  1. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
  2. 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
  3. 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
  4. 2022Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motioncited by 125
  5. 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
  6. 2022Learning Multi-dimensional Edge Feature-based AU Relation Graph for Facial Action Unit Recognitioncited by 81
  7. 2023HumanMAC: Masked Motion Completion for Human Motion Predictioncited by 81
  8. 2023DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatarscited by 42
  9. 2023Multiple Appropriate Facial Reaction Generation in Dyadic Interaction Settings: What, Why and How?cited by 16
  10. 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Predictioncited by 16

Built on by

Not cited yet.