T-QPM: Enabling Temporal Out-Of-Distribution Detection and Domain Generalization for Vision-Language Models in Open-World
On the map: Multimodal LLMs / vision-language models → Prompt learning and adaptation of CLIP
Abstract (arXiv)
Out-of-distribution (OOD) detection remains a critical challenge in open-world learning, where models must adapt to evolving data distributions. While recent vision-language models (VLMS) like CLIP enable multimodal OOD detection through Dual-Pattern Matching (DPM), existing methods typically suffer from two major shortcomings: (1) They rely on fixed fusion rules and assume static environments, failing under temporal drift; and (2) they lack robustness against covariate shifted inputs. In this paper, we propose a novel two-step framework to enhance OOD detection and covariate distribution shift robustness in dynamic settings. We extend the dual-pattern regime into Temporal Quadruple-Pattern Matching (T-QPM). First, by pairing OOD images with text descriptions, we introduce cross-modal consistency patterns between ID and OOD signals, refining the decision boundary through joint image-text reasoning. Second, we address temporal distribution shifts by learning lightweight fusion weights to optimally combine semantic matching and visual typicality. To ensure stability, we enforce explicit regularization based on Average Thresholded Confidence (ATC), preventing performance degradation as distributions evolve. Experiments on temporally partitioned benchmarks demonstrate that our approach significantly outperforms static baselines, offering a robust, temporally-consistent framework for multimodal OOD detection in non-stationary environments.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Prompt learning and adaptation of CLIP, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 34 of its 43 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
34 of 43 references.
Closest ancestors · 2
Same direction, newest first
- 2024Self-Calibrated Tuning of Vision-Language Models for Out-of-Distribution Detection5 Nov
- 2024Negative Label Guided OOD Detection with Pretrained Vision-Language Models29 Mar
Other references · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,352
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
- 2018Deep Anomaly Detection with Outlier Exposurecited by 939
- 2021Learning to Prompt for Continual Learningcited by 938
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 897
20 more
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 596
- 2017CORe50: a New Dataset and Benchmark for Continuous Object Recognitioncited by 287
- 2022Delving into Out-of-Distribution Detection with Vision-Language Representationscited by 215
- 2021Zero-Shot Out-of-Distribution Detection Based on the Pre-trained Model CLIPcited by 151
- 2022Leveraging Unlabeled Data to Predict Out-of-Distribution Performancecited by 141
- 2023CLIPN for Zero-Shot OOD Detection: Teaching CLIP to Say Nocited by 130
- 2023LoCoOp: Few-Shot Out-of-Distribution Detection via Prompt Learningcited by 107
- 2022The CLEAR Benchmark: Continual LEArning on Real-World Imagerycited by 92
- 2021OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalizationcited by 86
- 2022Training OOD Detectors in their Natural Habitatscited by 86
- 2022Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Timecited by 85
- 2023Feed Two Birds with One Scone: Exploiting Wild Data for Both Out-of-Distribution Generalization and Detectioncited by 57
- 2024Learning Transferable Negative Prompts for Out-of-Distribution Detectioncited by 43
- 2023GL-MCM: Global and Local Maximum Concept Matching for Zero-Shot Out-of-Distribution Detectioncited by 36
- 2024Open-world machine learning: A review and new outlookscited by 27
- 2024Continuous Temporal Domain Generalizationcited by 14
- 2024HYPO: Hyperspherical Out-of-Distribution Generalizationcited by 13
- 2023CODA: Temporal Domain Generalization via Concept Drift Simulatorcited by 6
- 2025Temp-SCONE: A Novel Out-of-Distribution Detection and Domain Generalization Framework for Wild Data with Temporal Shiftcited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Understanding Cross-Modal Contributions in Continual Vision-Language Models: A Theoretical Perspectivecited by 1
- 2026Cross-Contextual Vision-Language Adaptation with LoRA for Personalized Severe Adverse Event Detection in Clinical Wound Monitoringcited by 0
- 2026SABRE: A Multi-Agent Approach for Selecting Out-of-Distribution Detectors Under a Budgetcited by 0
- 2026SABRE: A Multi-Agent Approach for Selecting Out-of-Distribution Detectors Under a Budget3 Aug 2026
- 2026Cross-Contextual Vision-Language Adaptation with LoRA for Personalized Severe Adverse Event Detection in Clinical Wound Monitoring6 Jul 2026
- 2026Understanding Cross-Modal Contributions in Continual Vision-Language Models: A Theoretical Perspective12 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025A Benchmark and Evaluation for Real-World Out-of-Distribution Detection Using Vision-Language Models
- 2026TTL: Test-time Textual Learning for OOD Detection with Pretrained Vision-Language Models
- 2025Recent Advances in Out-of-Distribution Detection with CLIP-Like Models: A Survey
- 2025An Empirical Analysis of VLM-based OOD Detection: Mechanisms, Advantages, and Sensitivity
- 2023How Does Fine-Tuning Impact Out-of-Distribution Detection for Vision-Language Models?
- 2024Generalized Out-of-Distribution Detection and Beyond in Vision Language Model Era: A Survey
- 2025SimLabel: Consistency-Guided OOD Detection with Pretrained Vision-Language Models
- 2024CRoFT: Robust Fine-Tuning with Concurrent Optimization for OOD Generalization and Open-Set OOD Detection