mlsanityData to 13 Oct 2026

BiTimeCrossNet: Time-Aware Self-Supervised Learning for Pediatric Sleep

arXiv 2602.02769 ↗First posted 2 Feb 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

We present BiTimeCrossNet (BTCNet), a multimodal self-supervised learning framework for long physiological recordings such as overnight sleep studies. While many existing approaches train on short segments treated as independent samples, BTCNet incorporates information about when each segment occurs within its parent recording, for example within a sleep session. BTCNet further learns pairwise interactions between physiological signals via cross-attention, without requiring task labels or sequence-level supervision. We evaluate BTCNet on pediatric sleep data across six downstream tasks, including sleep staging, arousal detection, and respiratory event detection. Under frozen-backbone linear probing, BTCNet consistently outperforms an otherwise identical non-time-aware variant, with gains that generalize to an independent pediatric dataset. Compared to existing multimodal self-supervised sleep models, BTCNet achieves strong performance, particularly on respiration-related tasks.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 17 of its 41 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

17 of 41 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,492
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,364
  7. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,306
  8. 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 270
  9. 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 195
  10. 2024SleepFM: Multi-modal Representation Learning for Sleep Across Brain Activity, ECG and Respiratory Signalscited by 39
  11. 2021A Large Collection of Real-world Pediatric Sleep Studiescited by 20
  12. 2025Positional Encoding in Transformer-Based Time Series Models: A Surveycited by 13
5 more
  1. 2024NeuroNet: A Novel Hybrid Self-Supervised Learning Framework for Sleep Stage Classification Using Single-Channel EEGcited by 7
  2. 2022Automatic Sleep Scoring from Large-scale Multi-channel Pediatric EEGcited by 5
  3. 2024wav2sleep: A Unified Multi-Modal Approach to Sleep Stage Classification from Physiological Signalscited by 5
  4. 2024PedSleepMAE: Generative Model for Multimodal Pediatric Sleep Signalscited by 4
  5. 2025STAMP: Spatial-Temporal Adapter with Multi-Head Poolingcited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.