mlsanityData to 7 Oct 2026

MEGConformer: Conformer-Based MEG Decoder for Robust Speech and Phoneme Classification

arXiv 2512.01443 ↗First posted 1 Dec 2025cs.CL cs.LG cs.NEcited by 4

Not on the map. Why?

Abstract (arXiv)

Decoding speech-related information from non-invasive MEG is a key step toward scalable brain-computer interfaces. We present compact Conformer-based decoders on the LibriBrain 2025 PNPL benchmark for two core tasks: Speech Detection and Phoneme Classification. Our approach adapts a compact Conformer to raw 306-channel MEG signals, with a lightweight convolutional projection layer and task-specific heads. For Speech Detection, a MEG-oriented SpecAugment provided a first exploration of MEG-specific augmentation. For Phoneme Classification, we used inverse-square-root class weighting and a dynamic grouping loader to handle 100-sample averaged examples. In addition, a simple instance-level normalization proved critical to mitigate distribution shifts on the holdout split. Using the official Standard track splits and F1-macro for model selection, our best systems achieved 88.9% (Speech) and 65.8% (Phoneme) on the leaderboard, winning the Phoneme Classification Standard track. For further implementation details, the technical documentation, source code, and checkpoints are available at https://github.com/neural2speech/libribrain-experiments.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 24 of its 46 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

24 of 46 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Scaling Laws for Neural Language Modelscited by 6,411
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  4. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  5. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
  6. 2019When Does Label Smoothing Help?cited by 985
  7. 2017A Structured Self-attentive Sentence Embeddingcited by 318
  8. 2022Decoding speech perception from non-invasive brain recordingscited by 129
  9. 2023Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognitioncited by 120
  10. 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understandingcited by 90
  11. 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 90
  12. 2023Brain decoding: toward real-time reconstruction of visual perceptioncited by 64
12 more
  1. 2022Squeezeformer: An Efficient Transformer for Automatic Speech Recognitioncited by 50
  2. 2021Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognitioncited by 42
  3. 2020SEANet: A Multi-modal Speech Enhancement Networkcited by 35
  4. 2025Scaling laws for decoding images from brain activitycited by 21
  5. 2025LibriBrain: Over 50 Hours of Within-Subject MEG to Improve Speech Decoding Methods at Scalecited by 20
  6. 2025The 2025 PNPL Competition: Speech Detection and Phoneme Classification in the LibriBrain Datasetcited by 16
  7. 2025Unlocking Non-Invasive Brain-to-Textcited by 14
  8. 2024ConvConcatNet: a deep convolutional neural network to reconstruct mel spectrogram from the EEGcited by 12
  9. 2024Unveiling Thoughts: A Review of Advancements in EEG Brain Signal Decoding into Textcited by 10
  10. 2025Elementary, My Dear Watson: Non-Invasive Neural Keyword Spotting in the LibriBrain Datasetcited by 3
  11. 2025Decoding Phone Pairs from MEG Signals Across Speech Modalitiescited by 2
  12. 2025Artificial Neural Networks for Magnetoencephalography: A review of an emerging fieldcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.