mlsanityData to 7 Oct 2026

Enhancing Quantitative Image Synthesis through Pretraining and Resolution Scaling for Bone Mineral Density Estimation from a Plain X-ray Image

arXiv 2407.20495 ↗First posted 30 Jul 2024eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

While most vision tasks are essentially visual in nature (for recognition), some important tasks, especially in the medical field, also require quantitative analysis (for quantification) using quantitative images. Unlike in visual analysis, pixel values in quantitative images correspond to physical metrics measured by specific devices (e.g., a depth image). However, recent work has shown that it is sometimes possible to synthesize accurate quantitative values from visual ones (e.g., depth from visual cues or defocus). This research aims to improve quantitative image synthesis (QIS) by exploring pretraining and image resolution scaling. We propose a benchmark for evaluating pretraining performance using the task of QIS-based bone mineral density (BMD) estimation from plain X-ray images, where the synthesized quantitative image is used to derive BMD. Our results show that appropriate pretraining can improve QIS performance, significantly raising the correlation of BMD estimation from 0.820 to 0.898, while others do not help or even hinder it. Scaling-up the resolution can further boost the correlation up to 0.923, a significant enhancement over conventional methods. Future work will include exploring more pretraining strategies and validating them on other image synthesis tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 32 references that are in the map. First posted on arXiv 30 Jul 2024.

Builds on

15 of 32 references.

References · 15

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  5. 2020Supervised Contrastive Learningcited by 2,803
  6. 2021Self-Supervised Pretraining Improves Self-Supervised Pretrainingcited by 81
  7. 2019Automated Muscle Segmentation from Clinical CT using Bayesian U-Net for Personalized Musculoskeletal Modelingcited by 22
  8. 2020Deep Learning-Based Regression and Classification for Automatic Landmark Localization in Medical Imagescited by 22
  9. 2021Data synthesis and adversarial networks: A review and meta-analysis in cancer imagingcited by 15
  10. 2019Towards annotation-efficient segmentation via image-to-image translationcited by 6
  11. 2022Lumbar Bone Mineral Density Estimation from Chest X-ray Images: Anatomy-aware Attentive Multi-ROI Modelingcited by 4
  12. 2020Automated segmentation of an intensity calibration phantom in clinical CT images using a convolutional neural networkcited by 3
3 more
  1. 2022BMD-GAN: Bone mineral density estimation using x-ray image decomposition into projections of bone-segmented quantitative computed tomography using hierarchical learningcited by 3
  2. 2023MSKdeX: Musculoskeletal (MSK) decomposition from an X-ray image for fine-grained estimation of lean muscle mass and muscle volumecited by 3
  3. 2023Bone mineral density estimation from a plain X-ray image by learning decomposition into projections of bone-segmented computed tomographycited by 3

Built on by

Not cited yet.