Non-Contrastive Learning-based Behavioural Biometrics for Smart IoT Devices
Not on the map. Why?
Abstract (arXiv)
Behaviour biometrics are being explored as a viable alternative to overcome the limitations of traditional authentication methods such as passwords and static biometrics. Also, they are being considered as a viable authentication method for IoT devices such as smart headsets with AR/VR capabilities, wearables, and erables, that do not have a large form factor or the ability to seamlessly interact with the user. Recent behavioural biometric solutions use deep learning models that require large amounts of annotated training data. Collecting such volumes of behaviour biometrics data raises privacy and usability concerns. To this end, we propose using SimSiam-based non-contrastive self-supervised learning to improve the label efficiency of behavioural biometric systems. The key idea is to use large volumes of unlabelled (and anonymised) data to build good feature extractors that can be subsequently used in supervised settings. Using two EEG datasets, we show that at lower amounts of labelled data, non-contrastive learning performs 4%-11% more than conventional methods such as supervised learning and data augmentation. We also show that, in general, self-supervised learning methods perform better than other baselines. Finally, through careful experimentation, we show various modifications that can be incorporated into the non-contrastive learning process to archive high performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 56 references that are in the map. First posted on arXiv 24 Oct 2022.
Builds on
33 of 56 references.
References · 33
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2020Supervised Contrastive Learningcited by 2,803
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2016Density estimation using Real NVPcited by 2,029
21 more
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2016Colorful Image Colorizationcited by 1,113
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
- 2016Conditional Image Generation with PixelCNN Decoderscited by 859
- 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
- 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 374
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
- 2021With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representationscited by 324
- 2021On Feature Decorrelation in Self-Supervised Learningcited by 160
- 2019Multi-task Self-Supervised Learning for Human Activity Detectioncited by 98
- 2020Exploring Contrastive Learning in Human Activity Recognition for Healthcarecited by 73
- 2022What Makes Good Contrastive Learning on Small-Scale Wearable-based Tasks?cited by 39
- 2019Self-supervised audio representation learning for mobile devicescited by 17
- 2016IDNet: Smartphone-based Gait Recognition with Convolutional Neural Networkscited by 10
- 2020Sensor-based Continuous Authentication of Smartphones' Users Using Behavioral Biometrics: A Contemporary Surveycited by 10
- 2020MusicID: A Brainwave-based User Authentication System for Internet of Thingscited by 1
Built on by
Not cited yet.