mlsanityData to 14 Oct 2026

The Heat is On: Thermal Facial Landmark Tracking

arXiv 2311.08308 ↗First posted 14 Nov 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Facial landmark tracking for thermal images requires tracking certain important regions of subjects' faces, using images from thermal images, which omit lighting and shading, but show the temperatures of their subjects. The fluctuations of heat in particular places reflect physiological changes like bloodflow and perspiration, which can be used to remotely gauge things like anxiety and excitement. Past work in this domain has been limited to only a very limited set of architectures and techniques. This work goes further by trying a comprehensive suit of various models with different components, such as residual connections, channel and feature-wise attention, as well as the practice of ensembling components of the network to work in parallel. The best model integrated convolutional and residual layers followed by a channel-wise self-attention layer, requiring less than 100K parameters.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 59 references that are in the map. First posted on arXiv 14 Nov 2023.

Builds on

27 of 59 references.

References · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  6. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  7. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  8. 2016Understanding deep learning requires rethinking generalizationcited by 1,674
  9. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
  10. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
  11. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
  12. 2014Neural Turing Machinescited by 644
15 more
  1. 2019Stand-Alone Self-Attention in Vision Modelscited by 542
  2. 2014Understanding Deep Image Representations by Inverting Themcited by 403
  3. 2014Recurrent Models of Visual Attentioncited by 349
  4. 2017Methods for Interpreting and Understanding Deep Neural Networkscited by 345
  5. 2021Ensemble deep learning: A reviewcited by 284
  6. 2016SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioningcited by 219
  7. 2018A System for Massively Parallel Hyperparameter Tuningcited by 202
  8. 2015DRAW: A Recurrent Neural Network For Image Generationcited by 191
  9. 2020Disentangled Non-Local Neural Networkscited by 132
  10. 2018Activation Functions: Comparison of trends in Practice and Research for Deep Learningcited by 130
  11. 2017Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networkscited by 109
  12. 2017Deep Alignment Network: A convolutional neural network for robust face alignmentcited by 44
  13. 2017The exploding gradient problem demystified - definition, prevalence, impact, origin, tradeoffs, and solutionscited by 14
  14. 2016A Functional Regression approach to Facial Landmark Trackingcited by 6
  15. 2020Multi-spectral Facial Landmark Detectioncited by 1

Built on by

Not cited yet.