# Predicting Cardiovascular Risk Factors from Retinal Fundus Photographs using Deep Learning

arXiv: https://arxiv.org/abs/1708.09843 · HTML: https://mlsanity.com/paper/1708.09843/

## Key facts

- Cited by 63 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 31 Aug 2017.

## Built on by (most cited first, 30 of 63)

- [The Medical Segmentation Decathlon](https://mlsanity.com/paper/2106.05735/) (2021)
- [Reading Race: AI Recognises Patient's Racial Identity In Medical Images](https://mlsanity.com/paper/2107.10356/) (2021)
- [Applications of Deep Learning in Fundus Images: A Review](https://mlsanity.com/paper/2101.09864/) (2021)
- [Detecting Shortcut Learning for Fair Medical AI using Shortcut Testing](https://mlsanity.com/paper/2207.10384/) (2022)
- [Gender Artifacts in Visual Datasets](https://mlsanity.com/paper/2206.09191/) (2022)
- [High-Throughput Precision Phenotyping of Left Ventricular Hypertrophy with Cardiovascular Deep Learning](https://mlsanity.com/paper/2106.12511/) (2021)
- [ContIG: Self-supervised Multimodal Contrastive Learning for Medical Imaging with Genetics](https://mlsanity.com/paper/2111.13424/) (2021)
- [A Benchmark of Ocular Disease Intelligent Recognition: One Shot for Multi-disease Detection](https://mlsanity.com/paper/2102.07978/) (2021)
- [VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformers](https://mlsanity.com/paper/2104.06757/) (2021)
- [VisionFM: a Multi-Modal Multi-Task Vision Foundation Model for Generalist Ophthalmic Artificial Intelligence](https://mlsanity.com/paper/2310.04992/) (2023)
- [Algorithm Fairness in AI for Medicine and Healthcare](https://mlsanity.com/paper/2110.00603/) (2021)
- [COVIDx-US -- An open-access benchmark dataset of ultrasound imaging data for AI-driven COVID-19 analytics](https://mlsanity.com/paper/2103.10003/) (2021)
- [WarpPINN: Cine-MR image registration with physics-informed neural networks](https://mlsanity.com/paper/2211.12549/) (2022)
- [How Reliable is Your Regression Model's Uncertainty Under Real-World Distribution Shifts?](https://mlsanity.com/paper/2302.03679/) (2023)
- [Medical Imaging and Machine Learning](https://mlsanity.com/paper/2103.01938/) (2021)
- [Deep Learning Discovery of Demographic Biomarkers in Echocardiography](https://mlsanity.com/paper/2207.06421/) (2022)
- [Explanatory Paradigms in Neural Networks](https://mlsanity.com/paper/2202.11838/) (2022)
- [Deep learning on fundus images detects glaucoma beyond the optic disc](https://mlsanity.com/paper/2103.11895/) (2021)
- [Audit to Forget: A Unified Method to Revoke Patients' Private Data in Intelligent Healthcare](https://mlsanity.com/paper/2302.09813/) (2023)
- [AI Fairness via Domain Adaptation](https://mlsanity.com/paper/2104.01109/) (2021)
- [LAD: A Hybrid Deep Learning System for Benign Paroxysmal Positional Vertigo Disorders Diagnostic](https://mlsanity.com/paper/2210.08282/) (2022)
- [A Generalizable Deep Learning System for Cardiac MRI](https://mlsanity.com/paper/2312.00357/) (2023)
- [Disentangling representations of retinal images with generative models](https://mlsanity.com/paper/2402.19186/) (2024)
- [Algorithmic encoding of protected characteristics in image-based models for disease detection](https://mlsanity.com/paper/2110.14755/) (2021)
- [LMOD: A Large Multimodal Ophthalmology Dataset and Benchmark for Large Vision-Language Models](https://mlsanity.com/paper/2410.01620/) (2024)
- [DR-VNet: Retinal Vessel Segmentation via Dense Residual UNet](https://mlsanity.com/paper/2111.04739/) (2021)
- [On the Robustness of Pretraining and Self-Supervision for a Deep Learning-based Analysis of Diabetic Retinopathy](https://mlsanity.com/paper/2106.13497/) (2021)
- [Uncertainty-Aware Body Composition Analysis with Deep Regression Ensembles on UK Biobank MRI](https://mlsanity.com/paper/2101.06963/) (2021)
- [Env-Aware Anomaly Detection: Ignore Style Changes, Stay True to Content!](https://mlsanity.com/paper/2210.03103/) (2022)
- [k-SALSA: k-anonymous synthetic averaging of retinal images via local style alignment](https://mlsanity.com/paper/2303.10824/) (2023)

## Abstract (arXiv)

Traditionally, medical discoveries are made by observing associations and then designing experiments to test these hypotheses. However, observing and quantifying associations in images can be difficult because of the wide variety of features, patterns, colors, values, shapes in real data. In this paper, we use deep learning, a machine learning technique that learns its own features, to discover new knowledge from retinal fundus images. Using models trained on data from 284,335 patients, and validated on two independent datasets of 12,026 and 999 patients, we predict cardiovascular risk factors not previously thought to be present or quantifiable in retinal images, such as such as age (within 3.26 years), gender (0.97 AUC), smoking status (0.71 AUC), HbA1c (within 1.39%), systolic blood pressure (within 11.23mmHg) as well as major adverse cardiac events (0.70 AUC). We further show that our models used distinct aspects of the anatomy to generate each prediction, such as the optic disc or blood vessels, opening avenues of further research.
