Representation Is Not Enough: Body-Localized Thermal Evidence for Contactless Stress and Craving Sensing in Opioid Use Disorder
Not on the map. Why?
Abstract (arXiv)
Removing wearables from physiological monitoring also removes their supervision: the signal indicating where and when a stress response occurred. Contactless stress sensing therefore becomes a weakly supervised evidence-localization problem, where a clip-level label must be traced to the body regions and moments that produced it. We address this with FABLE-Therm, a weakly supervised architecture that preserves localized evidence across body regions, time, and encoder-specific representations until the final decision. FABLE-Therm fuses frozen foundation-model encoders at the embedding level, with theory explaining why localized fusion can outperform feature concatenation and prediction averaging. We study this problem in opioid use disorder (OUD), where stress is a major relapse trigger and sustained wearable use can be difficult during early recovery. Using fixed thermal video, FABLE-Therm achieves 0.938 AUROC on held-out participants, and its learned representation transfers to self-reported craving, providing, to our knowledge, the first evidence that craving can be recovered from contactless thermal video. Localized evidence also enables participant-level analysis of deployment failure. We find that improving representation alone is insufficient for equitable deployment: additional data from the underserved group would recover only about half of the cohort gap, while the remainder reflects person-to-person heterogeneity. This modality-agnostic decomposition applies to models with identifiable subpopulations. Together with the first cohort-structured contactless thermal OUD benchmark, our results show that preserving localized evidence supports both accurate sensing and principled analysis of who a model fails and why.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 73 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
21 of 73 references.
References · 21
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,209
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2018Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNscited by 588
- 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 560
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 555
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 478
- 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 371
9 more
- 2017Snapshot Ensembles: Train 1, get M for freecited by 350
- 2020DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolutioncited by 222
- 2019MMTM: Multimodal Transfer Module for CNN Fusioncited by 129
- 2020Ethical Machine Learning in Health Carecited by 113
- 2021Trusted Multi-View Classificationcited by 94
- 2023Provable Dynamic Fusion for Low-Quality Multimodal Datacited by 82
- 2018A Review of Challenges and Opportunities in Machine Learning for Healthcited by 68
- 2024FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusioncited by 68
- 2024InfMAE: A Foundation Model in the Infrared Modalitycited by 11
Built on by
Not cited yet.