mlsanityData to 7 Oct 2026

Not Every Subject Should Stay: Machine Unlearning for Noisy Engagement Recognition

arXiv 2605.04713 ↗First posted 6 May 2026cs.CVcited by 0

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Engagement recognition datasets are typically subject-indexed and often contain noisy, subjective supervision, making post-hoc dataset revision a practical problem. Existing noisy-label and data-cleaning methods largely operate at the sample level before or during training, but do not directly address a different question: once a model has already been trained, can the influence of an entire problematic subject be removed without full retraining? We study this setting through subject-level machine unlearning as a post-hoc sanitization mechanism for engagement recognition. Starting from a baseline trained on all subjects, we rank candidate harmful subjects using a model-dependent proxy, apply a lightweight approximate unlearning update, and compare the result against an oracle model retrained from scratch on the retained subjects only. We instantiate this protocol on DAiSEE and EngageNet using Tensor-Convolution and Convolution-Transformer Network (TCCT-Net) as a fixed platform and evaluate three matched model states under the same removal scenario: baseline, unlearned, and oracle. In representative K=3 forget-set settings, the unlearned model recovers 89.3% and 92.5% of the oracle gain on EngageNet and DAiSEE, respectively, at roughly one quarter of retraining cost. Across the tested small-audit regimes, effectiveness is strongest at an intermediate forget-set size, indicating that approximate subject-level unlearning is a useful low-cost correction mechanism, but one whose benefit depends on subject selection quality and removal regime.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 28 of its 35 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

28 of 35 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Machine Unlearning: A Comprehensive Survey13 May
  2. 2021On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning22 Oct

Other references · 26

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  3. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,053
  4. 2019Machine Unlearningcited by 1,020
  5. 2018Learning to Reweight Examples for Robust Deep Learningcited by 670
  6. 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 669
  7. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
  8. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
  9. 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 580
  10. 2019Certified Data Removal from Machine Learning Modelscited by 512
  11. 2019Making AI Forget You: Data Deletion in Machine Learningcited by 447
  12. 2020Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamicscited by 423
14 more
  1. 2019Confident Learning: Estimating Uncertainty in Dataset Labelscited by 411
  2. 2020Amnesiac Machine Learningcited by 305
  3. 2020Descent-to-Delete: Gradient-Based Methods for Machine Unlearningcited by 303
  4. 2020Identifying Mislabeled Data using the Area Under the Margin Rankingcited by 259
  5. 2022Federated Unlearning: How to Efficiently Erase a Client in FL?cited by 90
  6. 2016DAiSEE: Towards User Engagement Recognition in the Wildcited by 39
  7. 2024Generative Unlearning for Any Identitycited by 19
  8. 2023Do I Have Your Attention: A Large Scale Engagement Prediction Dataset and Baselinescited by 17
  9. 2024TCCT-Net: Two-Stream Network Architecture for Fast and Efficient Engagement Estimation via Behavioral Feature Signalscited by 7
  10. 2024Analyzing Participants' Engagement during Online Meetings Using Unsupervised Remote Photoplethysmography with Behavioral Featurescited by 5
  11. 2024Computational Analysis of Stress, Depression and Engagement in Mental Health: A Surveycited by 4
  12. 2023CMOSE: Comprehensive Multi-Modality Online Student Engagement Dataset with High-Quality Labelscited by 3
  13. 2025Vision Large Language Models Are Good Noise Handlers in Engagement Analysiscited by 2
  14. 2026PriorNet: Prior-Guided Engagement Estimation from Face Videocited by 1

Built on by

Not cited yet.