mlsanityData to 14 Oct 2026

Cross-Contextual Vision-Language Adaptation with LoRA for Personalized Severe Adverse Event Detection in Clinical Wound Monitoring

arXiv 2607.05625 ↗First posted 6 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Wound monitoring is a critical yet underserved clinical challenge, where timely identification of severe adverse events (SAEs) such as infection, tissue deterioration, and delayed healing can significantly impact patient outcomes. While vision-language models (VLMs) show strong multimodal reasoning, they often lack domain-specific grounding to integrate wound imagery with heterogeneous clinical information, and provide limited mechanisms for detecting cases that diverge from the training distribution. We present a multimodal framework for automated wound monitoring and SAE detection. Our approach leverages paired clinical notes and wound descriptions capturing visual characteristics such as appearance, surrounding skin condition, color changes, and signs of inflammation or healing progression, encoded through a dual-stream Low-Rank Adaptation (LoRA) framework built on a frozen BiomedCLIP backbone. We introduce a cross-contextual LoRA fusion mechanism enabling information exchange between clinical semantics and visual wound descriptors, producing context-aware multimodal representations without full model fine-tuning. To identify personalized SAEs, we propose a wound-specific out-of-distribution (OOD) detection framework combining semantic matching, visual typicality, caption-text alignment, and caption-visual alignment into a unified SAE (OOD) score. To capture healing dynamics, we incorporate covariate consistency and temporal drift penalties that leverage changes in wound characteristics across visits. Experiments on a longitudinal wound dataset collected through clinical visits show promising performance on both wound healing assessment and SAE detection, highlighting the potential of semantically enriched, temporally aware vision-language systems for clinical wound monitoring and early risk identification.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 48 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

43 of 48 references.

References · 43

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  6. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  7. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  8. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  9. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
  10. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
  11. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
  12. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
31 more
  1. 2020Energy-based Out-of-distribution Detectioncited by 1,299
  2. 2018Deep Anomaly Detection with Outlier Exposurecited by 942
  3. 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
  4. 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 600
  5. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
  6. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
  7. 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
  8. 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
  9. 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 405
  10. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
  11. 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 357
  12. 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 315
  13. 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 268
  14. 2022Delving into Out-of-Distribution Detection with Vision-Language Representationscited by 216
  15. 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
  16. 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 211
  17. 2020Autoencoders for Unsupervised Anomaly Segmentation in Brain MR Images: A Comparative Studycited by 147
  18. 2023CLIPN for Zero-Shot OOD Detection: Teaching CLIP to Say Nocited by 130
  19. 2023LoCoOp: Few-Shot Out-of-Distribution Detection via Prompt Learningcited by 107
  20. 2022Denoising diffusion models for out-of-distribution detectioncited by 104
  21. 2023GL-MCM: Global and Local Maximum Concept Matching for Zero-Shot Out-of-Distribution Detectioncited by 36
  22. 2020Fully Automatic Wound Segmentation with Deep Convolutional Neural Networkscited by 32
  23. 2024Out-of-distribution Detection in Medical Image Analysis: A surveycited by 22
  24. 2021Detect-and-Segment: a Deep Learning Approach to Automate Wound Image Segmentationcited by 12
  25. 2020Image Based Artificial Intelligence in Wound Assessment: A Systematic Reviewcited by 11
  26. 2021Multi-modal Wound Classification using Wound Image and Location by Deep Neural Networkcited by 10
  27. 2020Multiclass Wound Image Classification using an Ensemble Deep CNN-based Classifiercited by 9
  28. 2021Diabetic Foot Ulcer Grand Challenge 2021: Evaluation and Summarycited by 8
  29. 2026T-QPM: Enabling Temporal Out-Of-Distribution Detection and Domain Generalization for Vision-Language Models in Open-Worldcited by 3
  30. 2025Multimodal AI on Wound Images and Clinical Notes for Home Patient Referralcited by 1
  31. 2026Understanding Cross-Modal Contributions in Continual Vision-Language Models: A Theoretical Perspectivecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Infection-Reasoner: A Compact Vision-Language Model for Wound Infection Classification with Evidence-Grounded Clinical Reasoning
  2. 2025Explainable, Multi-modal Wound Infection Classification from Images Augmented with Generated Captions
  3. 2025Distribution-Based Masked Medical Vision-Language Model Using Structured Reports
  4. 2023Towards Concept-based Interpretability of Skin Lesion Diagnosis using Vision-Language Models
  5. 2025Taming Vision-Language Models for Medical Image Analysis: A Comprehensive Review
  6. 2025Decoupling Clinical and Class-Agnostic Features for Reliable Few-Shot Adaptation under Shift
  7. 2026LUTSeg: A Longitudinal Multi-Expert Dataset for Ulcer Tissue Segmentation
  8. 2026In-Context Learning for Wound Classification with Small Multimodal Language Models