mlsanityData to 7 Oct 2026

Beyond Hearing: Learning Task-Agnostic ExG Representations from Earphones via Physiology-Informed Tokenization

arXiv 2510.20853 ↗First posted 22 Oct 2025eess.AS cs.CL cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

Electrophysiological (ExG) signals offer valuable insights into human physiology, yet building foundation models that generalize across everyday tasks remains challenging due to two key limitations: (i)~insufficient data diversity, as most ExG recordings are collected in controlled labs with bulky, expensive devices; and (ii)~task-specific model designs that require tailored processing (i.e., targeted frequency filters) and architectures, which limit generalization across tasks. To address these challenges, we introduce an approach for scalable, task-agnostic ExG monitoring in the wild. We collected 50 hours of unobtrusive free-living ExG data with an earphone-based hardware prototype to narrow the data diversity gap. At the core of our approach is Physiology-informed Multi-band Tokenization (PiMT), which decomposes ExG signals into 12 physiology-informed tokens, followed by a reconstruction task to learn robust representations. This enables adaptive feature recognition across the full frequency spectrum while capturing task-relevant information. Experiments on our new DailySense dataset, the first to enable ExG-based analysis across five human senses, together with four public ExG benchmarks, demonstrate that PiMT consistently outperforms state-of-the-art methods across diverse tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 52 references that are in the map. First posted on arXiv 22 Oct 2025.

Builds on

16 of 52 references.

References · 16

  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  4. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  5. 2016EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfacescited by 616
  6. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
  7. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
  8. 2024Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modelingcited by 108
  9. 2018The Temple University Hospital Seizure Detection Corpuscited by 80
  10. 2023Neuro-GPT: Towards A Foundation Model for EEGcited by 69
  11. 2024Scaling Wearable Foundation Modelscited by 57
  12. 2024Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series Classificationcited by 53
4 more
  1. 2024SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Modelcited by 36
  2. 2024BrainWave: A Brain Signal Foundation Model for Clinical Applicationscited by 26
  3. 2025NeurIPT: Foundation Model for Neural Interfacescited by 9
  4. 2023Decoding Taste Information in Human Brain: A Temporal and Spatial Reconstruction Data Augmentation Method Coupled with Taste EEGcited by 1

Built on by

Not cited yet.