mlsanityData to 14 Oct 2026

Test-time Adaptive Hierarchical Co-enhanced Denoising Network for Reliable Multimodal Classification

arXiv 2601.07163 ↗First posted 12 Jan 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reliable learning of multimodal data (e.g., multi-omics) is a widely concerning issue, especially in safety-critical applications such as medical diagnosis. However, low-quality data induced by multimodal noise poses a major challenge in this domain, causing existing methods to suffer from two key limitations. First, they struggle to handle heterogeneous data noise, hindering robust multimodal representation learning. Second, they exhibit limited adaptability and generalization when encountering previously unseen noise. To address these issues, we propose Test-time Adaptive Hierarchical Co-enhanced Denoising Network (TAHCD). On one hand, TAHCD introduces the Adaptive Stable Subspace Alignment and Sample-Adaptive Confidence Alignment to reliably remove heterogeneous noise. They account for noise at both global and instance levels and enable jointly removal of modality-specific and cross-modality noise, achieving robust learning. On the other hand, TAHCD introduces Test-Time Cooperative Enhancement, which adaptively updates the model in response to input noise in a label-free manner, thus improving generalization. This is achieved by collaboratively enhancing the joint removal process of modality-specific and cross-modality noise across global and instance levels according to sample noise. Experiments on multiple benchmarks demonstrate that the proposed method achieves superior classification performance, robustness, and generalization compared with state-of-the-art reliable multimodal learning approaches.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 64 references that are in the map. First posted on arXiv 12 Jan 2026.

Builds on

27 of 64 references.

References · 27

  1. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  2. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,619
  3. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
  4. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,214
  5. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  6. 2023DataComp: In search of the next generation of multimodal datasetscited by 644
  7. 2020Learning Robust Representations via Multi-View Information Bottleneckcited by 191
  8. 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 168
  9. 2018Exploring Uncertainty Measures in Deep Networks for Multiple Sclerosis Lesion Detection and Segmentationcited by 146
  10. 2021Trusted Multi-View Classificationcited by 94
  11. 2023Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Trainingcited by 91
  12. 2018Towards Safe Autonomous Driving: Capture Uncertainty in the Deep Neural Network For Lidar 3D Vehicle Detectioncited by 82
15 more
  1. 2023Provable Dynamic Fusion for Low-Quality Multimodal Datacited by 82
  2. 2024Multimodal Fusion on Low-quality Data: A Comprehensive Surveycited by 49
  3. 2023Understanding Multimodal Contrastive Learning and Incorporating Unpaired Datacited by 43
  4. 2021A Variational Information Bottleneck Approach to Multi-Omics Data Integrationcited by 40
  5. 2022Uncertainty-Aware Multi-View Representation Learningcited by 29
  6. 2023Fully Sparse Fusion for 3D Object Detectioncited by 29
  7. 2022Vision+X: A Survey on Multimodal Learning in the Light of Datacited by 22
  8. 2022NLIP: Noise-robust Language-Image Pre-trainingcited by 20
  9. 2024Predictive Dynamic Fusioncited by 17
  10. 2023Semantic Invariant Multi-view Clustering with Fully Incomplete Informationcited by 12
  11. 2021Channel Exchanging Networks for Multimodal and Multitask Dense Image Predictioncited by 11
  12. 2023Noisy Correspondence Learning with Self-Reinforcing Errors Mitigationcited by 5
  13. 2024Disentangled Noisy Correspondence Learningcited by 4
  14. 2024SIAVC: Semi-Supervised Framework for Industrial Accident Video Classificationcited by 3
  15. 2018Rate-Accuracy Trade-Off In Video Classification With Deep Convolutional Neural Networkscited by 2

Built on by

Not cited yet.