mlsanityData to 14 Oct 2026

Robust Domain Generalization for Multi-modal Object Recognition

arXiv 2408.05831 ↗First posted 11 Aug 2024cs.CV cs.AIcited by 18

Not on the map. Why?

Abstract (arXiv)

In multi-label classification, machine learning encounters the challenge of domain generalization when handling tasks with distributions differing from the training data. Existing approaches primarily focus on vision object recognition and neglect the integration of natural language. Recent advancements in vision-language pre-training leverage supervision from extensive visual-language pairs, enabling learning across diverse domains and enhancing recognition in multi-modal scenarios. However, these approaches face limitations in loss function utilization, generality across backbones, and class-aware visual fusion. This paper proposes solutions to these limitations by inferring the actual loss, broadening evaluations to larger vision-language backbones, and introducing Mixup-CLIPood, which incorporates a novel mix-up loss for enhanced class-aware visual fusion. Our method demonstrates superior performance in domain generalization across multiple datasets.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 18 of its 25 references that are in the map. First posted on arXiv 11 Aug 2024.

Builds on

18 of 25 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  5. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  6. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  7. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
  8. 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,188
  9. 2017Deeper, Broader and Artier Domain Generalizationcited by 986
  10. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
  11. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
  12. 2020Learning to Learn Single Domain Generalizationcited by 296
6 more
  1. 2019Domain Generalization Using a Mixture of Multiple Latent Domainscited by 170
  2. 2020Maximum-Entropy Adversarial Data Augmentation for Improved Generalization and Robustnesscited by 121
  3. 2023CLIPood: Generalizing CLIP to Out-of-Distributionscited by 96
  4. 2022Style-Hallucinated Dual Consistency Learning for Domain Generalized Semantic Segmentationcited by 89
  5. 2023PLGSLAM: Progressive Neural Scene Represenation with Local to Global Bundle Adjustmentcited by 63
  6. 2024A Dual-Augmentor Framework for Domain Generalization in 3D Human Pose Estimationcited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 16; 2025: 1; 2026: 1.

18 papers.

Sort:

By area:

  1. 2024Efficient Fine-Tuning of Large Language Models for Automated Medical Documentationcited by 16
  2. 2024AR Overlay: Training Image Pose Estimation on Curved Surface in a Synthetic Waycited by 15
  3. 2025CLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Surveycited by 15
  4. 2024EITNet: An IoT-Enhanced Framework for Real-Time Basketball Action Recognitioncited by 8
  5. 2024Predicting 30-Day Hospital Readmission in Medicare Patients: Insights from an LSTM Deep Learning Modelcited by 8
  6. 2024Real-time Monitoring of Lower Limb Movement Resistance Based on Deep Learningcited by 8
  7. 2024LTPNet Integration of Deep Learning and Environmental Decision Support Systems for Renewable Energy Demand Forecastingcited by 7
  8. 2024In-Trajectory Inverse Reinforcement Learning: Learn Incrementally Before An Ongoing Trajectory Terminatescited by 7
  9. 2024A GEN AI Framework for Medical Note Generationcited by 6
  10. 2024TRIZ Method for Urban Building Energy Optimization: GWO-SARIMA-LSTM Forecasting modelcited by 6
  11. 2024Adaptive Self-Supervised Learning Strategies for Dynamic On-Device LLM Personalizationcited by 5
  12. 2024GTA-Net: An IoT-Integrated 3D Human Pose Estimation System for Real-Time Adolescent Sports Posture Correctioncited by 5
6 more
  1. 2024Evaluating Pre-trained Convolutional Neural Networks and Foundation Models as Feature Extractors for Content-based Medical Image Retrievalcited by 4
  2. 2024Research on Key Technologies for Cross-Cloud Federated Training of Large Language Modelscited by 4
  3. 2024Enhancing Exchange Rate Forecasting with Explainable Deep Learning Modelscited by 2
  4. 2024Detecting and Classifying Defective Products in Images Using YOLOcited by 2
  5. 2024Dynamic Attention and Bi-directional Fusion for Safety Helmet Wearing Detectioncited by 0
  6. 2026Label-Decoupled Style Augmentation for Domain Generalization in Multi-Label Remote Sensing Scene Classificationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Leveraging Vision-Language Models for Improving Domain Generalization in Image Classification
  2. 2026[CLS] is Not Enough: Multi-Label Recognition via Patch-Level Inference and Adaptive Aggregation
  3. 2023Strong but simple: A Baseline for Domain Generalized Dense Perception by CLIP-based Transfer Learning
  4. 2025Latent Domain Prompt Learning for Vision-Language Models
  5. 2026Domain Generalization via Text-Anchored Information Bottleneck
  6. 2023Text as Image: Learning Transferable Adapter for Multi-Label Classification
  7. 2026Adapting Vision-Language Models from Iconic to Inclusive for Multi-Label Recognition Without Labels
  8. 2025Explaining Domain Shifts in Language: Concept erasing for Interpretable Image Classification