mlsanityData to 7 Oct 2026

A Generative Approach for Image Registration of Visible-Thermal (VT) Cancer Faces

arXiv 2308.12271 ↗First posted 23 Aug 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Since thermal imagery offers a unique modality to investigate pain, the U.S. National Institutes of Health (NIH) has collected a large and diverse set of cancer patient facial thermograms for AI-based pain research. However, differing angles from camera capture between thermal and visible sensors has led to misalignment between Visible-Thermal (VT) images. We modernize the classic computer vision task of image registration by applying and modifying a generative alignment algorithm to register VT cancer faces, without the need for a reference or alignment parameters. By registering VT faces, we demonstrate that the quality of thermal images produced in the generative AI downstream task of Visible-to-Thermal (V2T) image translation significantly improves up to 52.5%, than without registration. Images in this paper have been approved by the NIH NCI for public dissemination.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 30 references that are in the map. First posted on arXiv 23 Aug 2023.

Builds on

15 of 30 references.

References · 15

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  5. 2015Spatial Transformer Networkscited by 1,423
  6. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
  7. 2019Making Convolutional Networks Shift-Invariant Againcited by 390
  8. 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
  9. 2020Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translationcited by 66
  10. 2021A Large-Scale, Time-Synchronized Visible and Thermal Face Datasetcited by 23
  11. 2022A new face database simultaneously acquired in visible, near infrared and thermal spectrumcited by 8
  12. 2020The Use of AI for Thermal Emotion Recognition: A Review of Problems and Limitations in Standard Design and Datacited by 6
3 more
  1. 2023When Visible-to-Thermal Facial GAN Beats Conditional Diffusioncited by 4
  2. 2022Intelligent Sight and Sound: A Chronic Cancer Pain Datasetcited by 3
  3. 2023Vista-Morph: Unsupervised Image Registration of Visible-Thermal Facial Pairscited by 1

Built on by

Not cited yet.