mlsanityData to 7 Oct 2026

Device Passport: Enabling Spatio-Temporal Pretrained Models to Generalize Across Input Layouts

arXiv 2607.00249 ↗First posted 30 Jun 2026cs.LG eess.SPcited by 0

Not on the map. Why?

Abstract (arXiv)

New device layouts pose a challenging modeling problem due to the lack of large datasets for each specific layout. Biosignal foundation models offer a plausible solution if they are able to generalize to new layouts effectively. To improve cross-layout transfer, we study how different channel embedding techniques behave when pretraining layouts differ substantially from the downstream decoding layout. We propose Device Passport, a new channel embedding technique that learns experts and mixture models that take each channel's functional activity and metadata as input. This contrasts with prior embedding methods, which typically use only functional information or only metadata to look up learned or fixed positional embeddings. Across controlled subset-transfer experiments and realistic transfer to ear-EEG, Device Passport is competitive overall and improves over the strongest learned baseline in the layout-transfer regimes that motivate this work. These results suggest that channel embedding design is a key consideration when reusing large-scale pretrained biosignal models on new devices.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 19 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

7 of 19 references.

References · 7

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Conditional Positional Encodings for Vision Transformerscited by 402
  3. 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
  4. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
  5. 2023Large-scale Training of Foundation Models for Wearable Biosignalscited by 89
  6. 2023A Unified, Scalable Framework for Neural Population Decodingcited by 59
  7. 2024Population Transformer: Learning Population-level Representations of Neural Activitycited by 26

Built on by

Not cited yet.