mlsanityData to 7 Oct 2026

Non-Contrastive Learning-based Behavioural Biometrics for Smart IoT Devices

arXiv 2210.12964 ↗First posted 24 Oct 2022cs.CR cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Behaviour biometrics are being explored as a viable alternative to overcome the limitations of traditional authentication methods such as passwords and static biometrics. Also, they are being considered as a viable authentication method for IoT devices such as smart headsets with AR/VR capabilities, wearables, and erables, that do not have a large form factor or the ability to seamlessly interact with the user. Recent behavioural biometric solutions use deep learning models that require large amounts of annotated training data. Collecting such volumes of behaviour biometrics data raises privacy and usability concerns. To this end, we propose using SimSiam-based non-contrastive self-supervised learning to improve the label efficiency of behavioural biometric systems. The key idea is to use large volumes of unlabelled (and anonymised) data to build good feature extractors that can be subsequently used in supervised settings. Using two EEG datasets, we show that at lower amounts of labelled data, non-contrastive learning performs 4%-11% more than conventional methods such as supervised learning and data augmentation. We also show that, in general, self-supervised learning methods perform better than other baselines. Finally, through careful experimentation, we show various modifications that can be incorporated into the non-contrastive learning process to archive high performance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 56 references that are in the map. First posted on arXiv 24 Oct 2022.

Builds on

33 of 56 references.

References · 33

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  7. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  8. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  9. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  10. 2020Supervised Contrastive Learningcited by 2,803
  11. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  12. 2016Density estimation using Real NVPcited by 2,029
21 more
  1. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  2. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
  3. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  4. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
  5. 2016Colorful Image Colorizationcited by 1,113
  6. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
  7. 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
  8. 2016Conditional Image Generation with PixelCNN Decoderscited by 859
  9. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
  10. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  11. 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 374
  12. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
  13. 2021With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representationscited by 324
  14. 2021On Feature Decorrelation in Self-Supervised Learningcited by 160
  15. 2019Multi-task Self-Supervised Learning for Human Activity Detectioncited by 98
  16. 2020Exploring Contrastive Learning in Human Activity Recognition for Healthcarecited by 73
  17. 2022What Makes Good Contrastive Learning on Small-Scale Wearable-based Tasks?cited by 39
  18. 2019Self-supervised audio representation learning for mobile devicescited by 17
  19. 2016IDNet: Smartphone-based Gait Recognition with Convolutional Neural Networkscited by 10
  20. 2020Sensor-based Continuous Authentication of Smartphones' Users Using Behavioral Biometrics: A Contemporary Surveycited by 10
  21. 2020MusicID: A Brainwave-based User Authentication System for Internet of Thingscited by 1

Built on by

Not cited yet.