# Robustness tests for biomedical foundation models should tailor to specifications

arXiv: https://arxiv.org/abs/2502.10374 · HTML: https://mlsanity.com/paper/2502.10374/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Feb 2025.

## Built on by (most cited first, 3 of 3)

- [Measuring temporal effects of agent knowledge by date-controlled tool use](https://mlsanity.com/paper/2503.04188/) (2025)
- [Foundation models for discovering robust biomarkers of neurological disorders from dynamic functional connectivity](https://mlsanity.com/paper/2604.22018/) (2026)
- [Beyond Benchmark Scores: Auditing Medical Vision-Language Models for Chest X-Ray Tuberculosis Screening](https://mlsanity.com/paper/2609.21763/) (2026)

## Abstract (arXiv)

The rise of biomedical foundation models creates new hurdles in model testing and authorization, given their broad capabilities and susceptibility to complex distribution shifts. We suggest tailoring robustness tests according to task-dependent priorities and propose to integrate granular notions of robustness in a predefined specification to guide implementation. Our approach facilitates the standardization of robustness assessments in the model lifecycle and connects abstract AI regulatory frameworks with concrete testing procedures.