mlsanityData to 7 Oct 2026

CRoP: Context-wise Robust Static Human-Sensing Personalization

arXiv 2409.17994 ↗First posted 26 Sep 2024cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The advancement in deep learning and internet-of-things have led to diverse human sensing applications. However, distinct patterns in human sensing, influenced by various factors or contexts, challenge the generic neural network model's performance due to natural distribution shifts. To address this, personalization tailors models to individual users. Yet most personalization studies overlook intra-user heterogeneity across contexts in sensory data, limiting intra-user generalizability. This limitation is especially critical in clinical applications, where limited data availability hampers both generalizability and personalization. Notably, intra-user sensing attributes are expected to change due to external factors such as treatment progression, further complicating the challenges. To address the intra-user generalization challenge, this work introduces CRoP, a novel static personalization approach. CRoP leverages off-the-shelf pre-trained models as generic starting points and captures user-specific traits through adaptive pruning on a minimal sub-network while allowing generic knowledge to be incorporated in remaining parameters. CRoP demonstrates superior personalization effectiveness and intra-user robustness across four human-sensing datasets, including two from real-world health domains, underscoring its practical and social impact. Additionally, to support CRoP's generalization ability and design choices, we provide empirical justification through gradient inner product analysis, ablation studies, and comparisons against state-of-the-art baselines.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 110 references that are in the map. First posted on arXiv 26 Sep 2024.

Builds on

44 of 110 references.

References · 44

  1. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  2. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
  3. 2017Adversarial Discriminative Domain Adaptationcited by 1,309
  4. 2016Pruning Filters for Efficient ConvNetscited by 1,129
  5. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
  6. 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 844
  7. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
  8. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
  9. 2015Cyclical Learning Rates for Training Neural Networkscited by 627
  10. 2017To prune, or not to prune: exploring the efficacy of pruning for model compressioncited by 596
  11. 2021Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networkscited by 521
  12. 2022Continual Test-Time Domain Adaptationcited by 520
32 more
  1. 2020Measuring Robustness to Natural Distribution Shifts in Image Classificationcited by 452
  2. 2017ThiNet: A Filter Level Pruning Method for Deep Neural Network Compressioncited by 438
  3. 2016Time Series Classification from Scratch with Deep Neural Networks: A Strong Baselinecited by 358
  4. 2021Gradient Matching for Domain Generalizationcited by 258
  5. 2021Self-Supervised Models are Continual Learnerscited by 149
  6. 2022Finetune like you pretrain: Improved finetuning of zero-shot vision modelscited by 149
  7. 2018Memory Efficient Experience Replay for Streaming Learningcited by 128
  8. 2018An introduction to domain adaptation and transfer learningcited by 112
  9. 2018Generative replay with feedback connections as a general strategy for continual learningcited by 103
  10. 2016DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processingcited by 84
  11. 2022Fisher SAM: Information Geometry and Sharpness Aware Minimisationcited by 84
  12. 2023Model Merging by Uncertainty-Based Gradient Matchingcited by 77
  13. 2020Maximum Density Divergence for Domain Adaptationcited by 76
  14. 2024Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilitiescited by 67
  15. 2020Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalizationcited by 61
  16. 2023Computationally Budgeted Continual Learning: What Does Matter?cited by 61
  17. 2019The Generalization-Stability Tradeoff In Neural Network Pruningcited by 54
  18. 2016Recognizing Detailed Human Context In-the-Wild from Smartphones and Smartwatchescited by 41
  19. 2022Pruning's Effect on Generalization Through the Lens of Training and Regularizationcited by 31
  20. 2023Test-Time Domain Adaptation by Learning Domain-Aware Batch Normalizationcited by 31
  21. 2023How Efficient Are Today's Continual Learning Algorithms?cited by 24
  22. 2023Kaizen: Practical Self-supervised Continual Learning with Continual Fine-tuningcited by 16
  23. 2020On Iterative Neural Network Pruning, Reinitialization, and the Similarity of Maskscited by 13
  24. 2022FIT: A Metric for Model Sensitivitycited by 10
  25. 2022Generalization and Personalization of Mobile Sensing-Based Mood Inference Models: An Analysis of College Students in Eight Countriescited by 10
  26. 2020Invariant Feature Learning for Sensor-based Human Activity Recognitioncited by 6
  27. 2022MobilePhys: Personalized Mobile Camera-Based Contactless Physiological Sensingcited by 4
  28. 2020Personalized Activity Recognition with Deep Triplet Embeddingscited by 3
  29. 2023Efficient Model Adaptation for Continual Learning at the Edgecited by 3
  30. 2024Balancing Continual Learning and Fine-tuning for Human Activity Recognitioncited by 3
  31. 2024Enhancing Continuous Domain Adaptation with Multi-Path Transfer Curriculumcited by 3
  32. 2023"Reading Between the Heat": Co-Teaching Body Thermal Signatures for Non-intrusive Stress Detectioncited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.