Purify-then-Align: Towards Robust Human Sensing under Modality Missing with Knowledge Distillation from Noisy Multimodal Teacher
On the map: Knowledge distillation → Multimodal distillation
Abstract (arXiv)
Robust multimodal human sensing must overcome the critical challenge of missing modalities. Two principal barriers are the Representation Gap between heterogeneous data and the Contamination Effect from low-quality modalities. These barriers are causally linked, as the corruption introduced by contamination fundamentally impedes the reduction of representation disparities. In this paper, we propose PTA, a novel "Purify-then-Align" framework that solves this causal dependency through a synergistic integration of meta-learning and knowledge diffusion. To purify the knowledge source, PTA first employs a meta-learning-driven weighting mechanism that dynamically learns to down-weight the influence of noisy, low-contributing modalities. Subsequently, to align different modalities, PTA introduces a diffusion-based knowledge distillation paradigm in which an information-rich clean teacher, formed from this purified consensus, refines the features of each student modality. The ultimate payoff of this "Purify-then-Align" strategy is the creation of exceptionally powerful single-modality encoders imbued with cross-modal knowledge. Comprehensive experiments on the large-scale MM-Fi and XRF55 datasets, under pronounced Representation Gap and Contamination Effect, demonstrate that PTA achieves state-of-the-art performance and significantly improves the robustness of single-modality models in diverse missing-modality scenarios.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal distillation, one of 12 directions in Knowledge distillation. Builds on 25 of its 50 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
25 of 50 references.
Closest ancestors · 1
Same direction, newest first
Other references · 24
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
- 2021Revisiting Skeleton-based Action Recognitioncited by 257
- 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 245
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2018Handling Incomplete Heterogeneous Data using VAEscited by 149
- 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 92
- 2023MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensingcited by 79
12 more
- 2019Person-in-WiFi: Fine-grained Person Perception using WiFicited by 57
- 2023Knowledge Diffusion for Distillationcited by 53
- 2020Training Strategies to Handle Missing Modalities for Audio-Visual Expression Recognitioncited by 36
- 2023milliFlow: Scene Flow Estimation on mmWave Radar Point Cloud for Human Motion Sensingcited by 20
- 2019Joint Activity Recognition and Indoor Localization with WiFi Fingerprintscited by 19
- 2024X-Fi: A Modality-Invariant Foundation Model for Multimodal Human Sensingcited by 13
- 2025Generating with Fairness: A Modality-Diffused Counterfactual Framework for Incomplete Multimodal Recommendationscited by 13
- 2025XRF V2: A Dataset for Action Summarization with Wi-Fi Signals, and IMUs in Phones, Watches, Earbuds, and Glassescited by 9
- 2025A Survey on Wi-Fi Sensing Generalizability: Taxonomy, Techniques, Datasets, and Future Research Prospectscited by 9
- 2023Federated Pseudo Modality Generation for Incomplete Multi-Modal MRI Reconstructioncited by 5
- 2024Meta-Learned Modality-Weighted Knowledge Distillation for Robust Multi-Modal Learning with Missing Datacited by 5
- 2025mmEgoHand: Egocentric Hand Pose Estimation and Gesture Recognition with Head-mounted Millimeter-wave Radar and IMUcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ConSensus: Multi-Agent Collaboration for Multimodal Sensing
- 2026ModalImmune: Immunity Driven Unlearning via Self Destructive Training
- 2026Cross-Modal Knowledge Distillation for Acoustic Pedestrian Detection
- 2026Diff-KD: Diffusion-based Knowledge Distillation for Collaborative Perception under Corruptions
- 2025G2D: Boosting Multimodal Learning with Gradient-Guided Distillation
- 2025Information-Theoretic Criteria for Knowledge Distillation in Multimodal Learning
- 2026VCR: Learning Valid Contextual Representation for Incomplete Wearable Signals
- 2025Preserving Cross-Modal Stability for Visual Unlearning in Multimodal Scenarios