mlsanityData to 7 Oct 2026

The Minimum Information about CLinical Artificial Intelligence Checklist for Generative Modeling Research (MI-CLAIM-GEN)

arXiv 2403.02558 ↗First posted 5 Mar 2024cs.CL cs.CVcited by 3

On the map: Multimodal LLMs / vision-language models → Medical vision-language models

also in 1 more
Abstract (arXiv)

Recent advances in generative models, including large language models (LLMs), vision language models (VLMs), and diffusion models, have accelerated the field of natural language and image processing in medicine and marked a significant paradigm shift in how biomedical models can be developed and deployed. While these models are highly adaptable to new tasks, scaling and evaluating their usage presents new challenges not addressed in previous frameworks. In particular, the ability of these models to produce useful outputs with little to no specialized training data ("zero-" or "few-shot" approaches), as well as the open-ended nature of their outputs, necessitate the development of new guidelines for robust reporting of clinical generative model research. In response to gaps in standards and best practices for the development of clinical AI tools identified by US Executive Order 141103 and several emerging national networks for clinical AI evaluation, we begin to formalize some of these guidelines by building on the original MI-CLAIM checklist. The new checklist, MI-CLAIM-GEN (Table 1), aims to address differences in training, evaluation, interpretability, and reproducibility of new generative models compared to non-generative ("predictive") AI models. This MI-CLAIM-GEN checklist also seeks to clarify cohort selection reporting with unstructured clinical data and adds additional items on alignment with ethical standards for clinical AI research.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 40 of its 77 references that are in the map. First posted on arXiv 5 Mar 2024.

Builds on

40 of 77 references.

References · 40

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  2. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  5. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  6. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  7. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  8. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  9. 2018Model Cards for Model Reportingcited by 1,068
  10. 2023Extracting Training Data from Diffusion Modelscited by 723
  11. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
  12. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 615
28 more
  1. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
  2. 2023GPTScore: Evaluate as You Desirecited by 357
  3. 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 339
  4. 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 319
  5. 2023State of What Art? A Call for Multi-Prompt LLM Evaluationcited by 299
  6. 2023How is ChatGPT's behavior changing over time?cited by 265
  7. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
  8. 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 224
  9. 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
  10. 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 154
  11. 2023From ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and Privacycited by 137
  12. 2020Self-Attention Attribution: Interpreting Information Interactions Inside Transformercited by 124
  13. 2022Interpreting Language Models with Contrastive Explanationscited by 91
  14. 2023Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?cited by 87
  15. 2024Red-Teaming for Generative AI: Silver Bullet or Security Theater?cited by 81
  16. 2020Hurtful Words: Quantifying Biases in Clinical Contextual Word Embeddingscited by 79
  17. 2024Towards Conversational Diagnostic AIcited by 79
  18. 2024From Understanding to Utilization: A Survey on Explainability for Large Language Modelscited by 47
  19. 2021Evaluating Saliency Methods for Neural Language Modelscited by 37
  20. 2023Beyond Privacy: Navigating the Opportunities and Challenges of Synthetic Datacited by 29
  21. 2020It's not a Non-Issue: Negation as a Source of Error in Machine Translationcited by 19
  22. 2023Clinical BERTScore: An Improved Measure of Automatic Speech Recognition Performance in Clinical Settingscited by 8
  23. 2023CORAL: Expert-Curated medical Oncology Reports to Advance Language Model Inferencecited by 8
  24. 2023Large Language Models as Agents in the Cliniccited by 4
  25. 2024Identifying Reasons for Contraceptive Switching from Real-World Data Using Large Language Modelscited by 4
  26. 2023Generative Artificial Intelligence in Healthcare: Ethical Considerations and Assessment Checklistcited by 3
  27. 2023Are foundation models efficient for medical image segmentation?cited by 2
  28. 2024LUNA: A Framework for Language Understanding and Naturalness Assessmentcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025From large language models to multimodal AI: A scoping review on the potential of generative AI in medicine
  2. 2025Generative AI for Healthcare: Fundamentals, Challenges, and Perspectives
  3. 2025Vision Language Models in Medicine
  4. 2025A Systematic Analysis of Declining Medical Safety Messaging in Generative AI Models
  5. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine
  6. 2025A Scoping Review of Synthetic Data Generation by Language Models in Biomedical Research and Application: Data Utility and Quality Perspectives
  7. 2023Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedback
  8. 2024Generative AI for Synthetic Data Across Multiple Medical Modalities: A Systematic Review of Recent Developments and Challenges