Multimodal Machine Learning-based Knee Osteoarthritis Progression Prediction from Plain Radiographs and Clinical Data
Not on the map. Why?
Abstract (arXiv)
Knee osteoarthritis (OA) is the most common musculoskeletal disease without a cure, and current treatment options are limited to symptomatic relief. Prediction of OA progression is a very challenging and timely issue, and it could, if resolved, accelerate the disease modifying drug development and ultimately help to prevent millions of total joint replacement surgeries performed annually. Here, we present a multi-modal machine learning-based OA progression prediction model that utilizes raw radiographic data, clinical examination results and previous medical history of the patient. We validated this approach on an independent test set of 3,918 knee images from 2,129 subjects. Our method yielded area under the ROC curve (AUC) of 0.79 (0.78-0.81) and Average Precision (AP) of 0.68 (0.66-0.70). In contrast, a reference approach, based on logistic regression, yielded AUC of 0.75 (0.74-0.77) and AP of 0.62 (0.60-0.64). The proposed method could significantly improve the subject selection process for OA drug-development trials and help the development of personalized therapeutic plans.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 7; 2024: 6; 2025: 1; 2026: 2.
23 papers.
Sort:
- 2022Integrated multimodal artificial intelligence framework for healthcare applicationscited by 69
- 2024A Closer Look at AUROC and AUPRC under Class Imbalancecited by 56
- 2024Review of multimodal machine learning approaches in healthcarecited by 30
- 2022Clinically-Inspired Multi-Agent Transformers for Disease Trajectory Forecasting from Multimodal Datacited by 10
- 2021CLIMAT: Clinically-Inspired Multi-Agent Transformers for Knee Osteoarthritis Trajectory Forecastingcited by 4
- 2022Predicting Knee Osteoarthritis Progression from Structural MRI using Deep Learningcited by 4
- 2022Multimodal Machine Learning in Precision Healthcited by 3
- 2023Exploring the Efficacy of Base Data Augmentation Methods in Deep Learning-Based Radiograph Classification of Knee Joint Osteoarthritiscited by 3
- 2021Image prediction of disease progression by style-based manifold extrapolationcited by 1
- 2022UNet Architectures in Multiplanar Volumetric Segmentation -- Validated on Three Knee MRI Cohortscited by 1
- 2023Evidence-aware multi-modal data fusion and its application to total knee replacement predictioncited by 1
- 2023End-To-End Prediction of Knee Osteoarthritis Progression With Multi-Modal Transformerscited by 1
11 more
- 2023Synthesizing Bidirectional Temporal States of Knee Osteoarthritis Radiographs with Cycle-Consistent Generative Adversarial Neural Networkscited by 1
- 2023Adaptive Variance Thresholding: A Novel Approach to Improve Existing Deep Transfer Vision Models and Advance Automatic Knee-Joint Osteoarthritis Classificationcited by 1
- 2024A Progressive Risk Formulation for Enhanced Deep Learning based Total Knee Replacement Prediction in Knee Osteoarthritiscited by 1
- 2023Deep Learning for Predicting Progression of Patellofemoral Osteoarthritis Based on Lateral Knee Radiographs, Demographic Data and Symptomatic Assessmentscited by 0
- 2023Deciphering knee osteoarthritis diagnostic features with explainable artificial intelligence: A systematic reviewcited by 0
- 2024Identity-Consistent Diffusion Network for Grading Knee Osteoarthritis Progression in Radiographic Imagingcited by 0
- 2024Toward Cost-efficient Adaptive Clinical Trials in Knee Osteoarthritis with Reinforcement Learningcited by 0
- 2024Emory Knee Radiograph (MRKR) Datasetcited by 0
- 2025Challenges and proposed solutions in modeling multimodal medical data: A systematic reviewcited by 0
- 2026PSSF: Early osteoarthritis detection using physical synthetic knee X-ray scans and AI radiomics modelscited by 0
- 2026A Discordance-Aware Multimodal Framework with Multi-Agent Clinical Reasoningcited by 0
- 2026A Discordance-Aware Multimodal Framework with Multi-Agent Clinical Reasoning12 Mar 2026
- 2026PSSF: Early osteoarthritis detection using physical synthetic knee X-ray scans and AI radiomics models14 Jan 2026
- 2025Challenges and proposed solutions in modeling multimodal medical data: A systematic review11 May 2025
- 2024Emory Knee Radiograph (MRKR) Dataset30 Oct 2024
- 2024Toward Cost-efficient Adaptive Clinical Trials in Knee Osteoarthritis with Reinforcement Learning5 Aug 2024
- 2024Identity-Consistent Diffusion Network for Grading Knee Osteoarthritis Progression in Radiographic Imaging31 Jul 2024
- 2024A Progressive Risk Formulation for Enhanced Deep Learning based Total Knee Replacement Prediction in Knee Osteoarthritis14 Jun 2024
- 2024Review of multimodal machine learning approaches in healthcare4 Feb 2024
- 2024A Closer Look at AUROC and AUPRC under Class Imbalance11 Jan 2024
- 2023Exploring the Efficacy of Base Data Augmentation Methods in Deep Learning-Based Radiograph Classification of Knee Joint Osteoarthritis10 Nov 2023
- 2023Adaptive Variance Thresholding: A Novel Approach to Improve Existing Deep Transfer Vision Models and Advance Automatic Knee-Joint Osteoarthritis Classification10 Nov 2023
- 2023Synthesizing Bidirectional Temporal States of Knee Osteoarthritis Radiographs with Cycle-Consistent Generative Adversarial Neural Networks10 Nov 2023
11 more
- 2023Deciphering knee osteoarthritis diagnostic features with explainable artificial intelligence: A systematic review18 Aug 2023
- 2023End-To-End Prediction of Knee Osteoarthritis Progression With Multi-Modal Transformers3 Jul 2023
- 2023Deep Learning for Predicting Progression of Patellofemoral Osteoarthritis Based on Lateral Knee Radiographs, Demographic Data and Symptomatic Assessments10 May 2023
- 2023Evidence-aware multi-modal data fusion and its application to total knee replacement prediction24 Mar 2023
- 2022Clinically-Inspired Multi-Agent Transformers for Disease Trajectory Forecasting from Multimodal Data25 Oct 2022
- 2022Multimodal Machine Learning in Precision Health10 Apr 2022
- 2022UNet Architectures in Multiplanar Volumetric Segmentation -- Validated on Three Knee MRI Cohorts15 Mar 2022
- 2022Integrated multimodal artificial intelligence framework for healthcare applications25 Feb 2022
- 2022Predicting Knee Osteoarthritis Progression from Structural MRI using Deep Learning26 Jan 2022
- 2021Image prediction of disease progression by style-based manifold extrapolation22 Nov 2021
- 2021CLIMAT: Clinically-Inspired Multi-Agent Transformers for Knee Osteoarthritis Trajectory Forecasting8 Apr 2021
- 2022Integrated multimodal artificial intelligence framework for healthcare applicationscited by 69
- 2024A Closer Look at AUROC and AUPRC under Class Imbalancecited by 56
- 2024Review of multimodal machine learning approaches in healthcarecited by 30
- 2022Clinically-Inspired Multi-Agent Transformers for Disease Trajectory Forecasting from Multimodal Datacited by 10
- 2021CLIMAT: Clinically-Inspired Multi-Agent Transformers for Knee Osteoarthritis Trajectory Forecastingcited by 4
- 2022Predicting Knee Osteoarthritis Progression from Structural MRI using Deep Learningcited by 4
- 2022Multimodal Machine Learning in Precision Healthcited by 3
- 2023Exploring the Efficacy of Base Data Augmentation Methods in Deep Learning-Based Radiograph Classification of Knee Joint Osteoarthritiscited by 3
- 2021Image prediction of disease progression by style-based manifold extrapolationcited by 1
- 2022UNet Architectures in Multiplanar Volumetric Segmentation -- Validated on Three Knee MRI Cohortscited by 1
- 2023Evidence-aware multi-modal data fusion and its application to total knee replacement predictioncited by 1
- 2023End-To-End Prediction of Knee Osteoarthritis Progression With Multi-Modal Transformerscited by 1
12 most cited of 23 All 23 (JSON)
- 2026A Discordance-Aware Multimodal Framework with Multi-Agent Clinical Reasoning12 Mar 2026
- 2026PSSF: Early osteoarthritis detection using physical synthetic knee X-ray scans and AI radiomics models14 Jan 2026
- 2025Challenges and proposed solutions in modeling multimodal medical data: A systematic review11 May 2025
- 2024Emory Knee Radiograph (MRKR) Dataset30 Oct 2024
- 2024Toward Cost-efficient Adaptive Clinical Trials in Knee Osteoarthritis with Reinforcement Learning5 Aug 2024
- 2024Identity-Consistent Diffusion Network for Grading Knee Osteoarthritis Progression in Radiographic Imaging31 Jul 2024
- 2024A Progressive Risk Formulation for Enhanced Deep Learning based Total Knee Replacement Prediction in Knee Osteoarthritis14 Jun 2024
- 2024Review of multimodal machine learning approaches in healthcare4 Feb 2024
- 2024A Closer Look at AUROC and AUPRC under Class Imbalance11 Jan 2024
- 2023Exploring the Efficacy of Base Data Augmentation Methods in Deep Learning-Based Radiograph Classification of Knee Joint Osteoarthritis10 Nov 2023
- 2023Adaptive Variance Thresholding: A Novel Approach to Improve Existing Deep Transfer Vision Models and Advance Automatic Knee-Joint Osteoarthritis Classification10 Nov 2023
- 2023Synthesizing Bidirectional Temporal States of Knee Osteoarthritis Radiographs with Cycle-Consistent Generative Adversarial Neural Networks10 Nov 2023
12 newest of 23 All 23 (JSON)