mlsanityData to 13 Oct 2026

A Full Transformer-based Framework for Automatic Pain Estimation using Videos

arXiv 2412.15095 ↗First posted 19 Dec 2024cs.CV cs.AI cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

The automatic estimation of pain is essential in designing an optimal pain management system offering reliable assessment and reducing the suffering of patients. In this study, we present a novel full transformer-based framework consisting of a Transformer in Transformer (TNT) model and a Transformer leveraging cross-attention and self-attention blocks. Elaborating on videos from the BioVid database, we demonstrate state-of-the-art performances, showing the efficacy, efficiency, and generalization capability across all the primary pain estimation tasks.

Key facts. Cited by 11 papers in the map (data through 13 Oct 2026). Builds on 8 of its 29 references that are in the map. First posted on arXiv 19 Dec 2024.

Builds on

8 of 29 references.

References · 8

  1. 2017Attention Is All You Needcited by 60,106
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  3. 2021Perceiver: General Perception with Iterative Attentioncited by 1,094
  4. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 913
  5. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 898
  6. 2021Transformer in Transformercited by 633
  7. 2020Transformer Interpretability Beyond Attention Visualizationcited by 623
  8. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 4; 2026: 7.

11 papers.

  1. 2025Efficient Pain Recognition via Respiration Signals: A Single Cross-Attention Transformer Multi-Window Fusion Pipelinecited by 11
  2. 2025PainFormer: a Vision Foundation Model for Automatic Pain Assessmentcited by 10
  3. 2025Multi-Representation Diagrams for Pain Recognition: Integrating Various Electrodermal Activity Signals into a Single Imagecited by 9
  4. 2025Tiny-BioMoE: a Lightweight Embedding Model for Biosignal Analysiscited by 8
  5. 2026A Lightweight Transformer for Pain Recognition from Brain Activitycited by 7
  6. 2026A Unified Tokenization Framework for Pain Recognition using Heterogeneous 3D Modalitiescited by 7
  7. 2026ReFace: Reorganizing Facial Spatiotemporal Representations for Improved Pain Assessmentcited by 7
  8. 2026One-Block Transformer (1BT) for EEG-Based Cognitive Workload Assessmentcited by 1
  9. 2026ReMiX-MAE: Learning Missing-Channel Cross-Modal Representations from RGB-Only Clinical Facial Videos for Sympathetic-Mediated Pain Assessmentcited by 0
  10. 2026FUSE: Frame-Unified Stress Estimation from Facial Videocited by 0
  11. 2026UNWIND: Any-Length Facial Video for Stress Detection without Temporal Windowingcited by 0