CRoP: Context-wise Robust Static Human-Sensing Personalization
Not on the map. Why?
Abstract (arXiv)
The advancement in deep learning and internet-of-things have led to diverse human sensing applications. However, distinct patterns in human sensing, influenced by various factors or contexts, challenge the generic neural network model's performance due to natural distribution shifts. To address this, personalization tailors models to individual users. Yet most personalization studies overlook intra-user heterogeneity across contexts in sensory data, limiting intra-user generalizability. This limitation is especially critical in clinical applications, where limited data availability hampers both generalizability and personalization. Notably, intra-user sensing attributes are expected to change due to external factors such as treatment progression, further complicating the challenges. To address the intra-user generalization challenge, this work introduces CRoP, a novel static personalization approach. CRoP leverages off-the-shelf pre-trained models as generic starting points and captures user-specific traits through adaptive pruning on a minimal sub-network while allowing generic knowledge to be incorporated in remaining parameters. CRoP demonstrates superior personalization effectiveness and intra-user robustness across four human-sensing datasets, including two from real-world health domains, underscoring its practical and social impact. Additionally, to support CRoP's generalization ability and design choices, we provide empirical justification through gradient inner product analysis, ablation studies, and comparisons against state-of-the-art baselines.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 110 references that are in the map. First posted on arXiv 26 Sep 2024.
Builds on
44 of 110 references.
References · 44
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2017Adversarial Discriminative Domain Adaptationcited by 1,309
- 2016Pruning Filters for Efficient ConvNetscited by 1,129
- 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
- 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 844
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2015Cyclical Learning Rates for Training Neural Networkscited by 627
- 2017To prune, or not to prune: exploring the efficacy of pruning for model compressioncited by 596
- 2021Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networkscited by 521
- 2022Continual Test-Time Domain Adaptationcited by 520
32 more
- 2020Measuring Robustness to Natural Distribution Shifts in Image Classificationcited by 452
- 2017ThiNet: A Filter Level Pruning Method for Deep Neural Network Compressioncited by 438
- 2016Time Series Classification from Scratch with Deep Neural Networks: A Strong Baselinecited by 358
- 2021Gradient Matching for Domain Generalizationcited by 258
- 2021Self-Supervised Models are Continual Learnerscited by 149
- 2022Finetune like you pretrain: Improved finetuning of zero-shot vision modelscited by 149
- 2018Memory Efficient Experience Replay for Streaming Learningcited by 128
- 2018An introduction to domain adaptation and transfer learningcited by 112
- 2018Generative replay with feedback connections as a general strategy for continual learningcited by 103
- 2016DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processingcited by 84
- 2022Fisher SAM: Information Geometry and Sharpness Aware Minimisationcited by 84
- 2023Model Merging by Uncertainty-Based Gradient Matchingcited by 77
- 2020Maximum Density Divergence for Domain Adaptationcited by 76
- 2024Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilitiescited by 67
- 2020Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalizationcited by 61
- 2023Computationally Budgeted Continual Learning: What Does Matter?cited by 61
- 2019The Generalization-Stability Tradeoff In Neural Network Pruningcited by 54
- 2016Recognizing Detailed Human Context In-the-Wild from Smartphones and Smartwatchescited by 41
- 2022Pruning's Effect on Generalization Through the Lens of Training and Regularizationcited by 31
- 2023Test-Time Domain Adaptation by Learning Domain-Aware Batch Normalizationcited by 31
- 2023How Efficient Are Today's Continual Learning Algorithms?cited by 24
- 2023Kaizen: Practical Self-supervised Continual Learning with Continual Fine-tuningcited by 16
- 2020On Iterative Neural Network Pruning, Reinitialization, and the Similarity of Maskscited by 13
- 2022FIT: A Metric for Model Sensitivitycited by 10
- 2022Generalization and Personalization of Mobile Sensing-Based Mood Inference Models: An Analysis of College Students in Eight Countriescited by 10
- 2020Invariant Feature Learning for Sensor-based Human Activity Recognitioncited by 6
- 2022MobilePhys: Personalized Mobile Camera-Based Contactless Physiological Sensingcited by 4
- 2020Personalized Activity Recognition with Deep Triplet Embeddingscited by 3
- 2023Efficient Model Adaptation for Continual Learning at the Edgecited by 3
- 2024Balancing Continual Learning and Fine-tuning for Human Activity Recognitioncited by 3
- 2024Enhancing Continuous Domain Adaptation with Multi-Path Transfer Curriculumcited by 3
- 2023"Reading Between the Heat": Co-Teaching Body Thermal Signatures for Non-intrusive Stress Detectioncited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025Human Heterogeneity Invariant Stress Sensingcited by 1
- 2025Human Heterogeneity Invariant Stress Sensing2 Jun 2025