mlsanityData to 7 Oct 2026

WhACC: Whisker Automatic Contact Classifier with Expert Human-Level Performance

arXiv 2501.06219 ↗First posted 6 Jan 2025cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The rodent vibrissal system is pivotal in advancing neuroscience research, particularly for studies of cortical plasticity, learning, decision-making, sensory encoding, and sensorimotor integration. Despite the advantages, curating touch events is labor intensive and often requires >3 hours per million video frames, even after leveraging automated tools like the Janelia Whisker Tracker. We address this limitation by introducing Whisker Automatic Contact Classifier (WhACC), a python package designed to identify touch periods from high-speed videos of head-fixed behaving rodents with human-level performance. WhACC leverages ResNet50V2 for feature extraction, combined with LightGBM for Classification. Performance is assessed against three expert human curators on over one million frames. Pairwise touch classification agreement on 99.5% of video frames, equal to between-human agreement. Finally, we offer a custom retraining interface to allow model customization on a small subset of data, which was validated on four million frames across 16 single-unit electrophysiology recordings. Including this retraining step, we reduce human hours required to curate a 100 million frame dataset from ~333 hours to ~6 hours.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 36 references that are in the map. First posted on arXiv 6 Jan 2025.

Builds on

10 of 36 references.

References · 10

  1. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  2. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  3. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  4. 2019Searching for MobileNetV3cited by 1,984
  5. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  6. 2017Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classificationcited by 521
  7. 2017A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time seriescited by 58
  8. 2019Depthwise Convolution is All You Need for Learning Multiple Visual Domainscited by 36
  9. 2019Gradient Boost with Convolution Neural Network for Stock Forecastcited by 1
  10. 2019Learning to Localize Temporal Events in Large-scale Video Datacited by 1

Built on by

Not cited yet.