MEGConformer: Conformer-Based MEG Decoder for Robust Speech and Phoneme Classification
Not on the map. Why?
Abstract (arXiv)
Decoding speech-related information from non-invasive MEG is a key step toward scalable brain-computer interfaces. We present compact Conformer-based decoders on the LibriBrain 2025 PNPL benchmark for two core tasks: Speech Detection and Phoneme Classification. Our approach adapts a compact Conformer to raw 306-channel MEG signals, with a lightweight convolutional projection layer and task-specific heads. For Speech Detection, a MEG-oriented SpecAugment provided a first exploration of MEG-specific augmentation. For Phoneme Classification, we used inverse-square-root class weighting and a dynamic grouping loader to handle 100-sample averaged examples. In addition, a simple instance-level normalization proved critical to mitigate distribution shifts on the holdout split. Using the official Standard track splits and F1-macro for model selection, our best systems achieved 88.9% (Speech) and 65.8% (Phoneme) on the leaderboard, winning the Phoneme Classification Standard track. For further implementation details, the technical documentation, source code, and checkpoints are available at https://github.com/neural2speech/libribrain-experiments.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 24 of its 46 references that are in the map. First posted on arXiv 1 Dec 2025.
Builds on
24 of 46 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2019When Does Label Smoothing Help?cited by 985
- 2017A Structured Self-attentive Sentence Embeddingcited by 318
- 2022Decoding speech perception from non-invasive brain recordingscited by 129
- 2023Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognitioncited by 120
- 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understandingcited by 90
- 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 90
- 2023Brain decoding: toward real-time reconstruction of visual perceptioncited by 64
12 more
- 2022Squeezeformer: An Efficient Transformer for Automatic Speech Recognitioncited by 50
- 2021Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognitioncited by 42
- 2020SEANet: A Multi-modal Speech Enhancement Networkcited by 35
- 2025Scaling laws for decoding images from brain activitycited by 21
- 2025LibriBrain: Over 50 Hours of Within-Subject MEG to Improve Speech Decoding Methods at Scalecited by 20
- 2025The 2025 PNPL Competition: Speech Detection and Phoneme Classification in the LibriBrain Datasetcited by 16
- 2025Unlocking Non-Invasive Brain-to-Textcited by 14
- 2024ConvConcatNet: a deep convolutional neural network to reconstruct mel spectrogram from the EEGcited by 12
- 2024Unveiling Thoughts: A Review of Advancements in EEG Brain Signal Decoding into Textcited by 10
- 2025Elementary, My Dear Watson: Non-Invasive Neural Keyword Spotting in the LibriBrain Datasetcited by 3
- 2025Decoding Phone Pairs from MEG Signals Across Speech Modalitiescited by 2
- 2025Artificial Neural Networks for Magnetoencephalography: A review of an emerging fieldcited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MEG-to-MEG Transfer Learning and Cross-Task Speech/Silence Detection with Limited Datacited by 0
- 2026Measuring Robustness of Speech Recognition from MEG Signals Under Distribution Shiftcited by 0
- 2026MindVoice: Reconstructing Intelligible Speech from Non-invasive Neural Signals with Pretrained Priorscited by 0
- 2026MeGA-MP: Metric Graph Advection Message Passing -- A Physics-Informed Message Passing Operator for Advection-Dominated Metric Graphscited by 0
- 2026MeGA-MP: Metric Graph Advection Message Passing -- A Physics-Informed Message Passing Operator for Advection-Dominated Metric Graphs6 Jul 2026
- 2026MindVoice: Reconstructing Intelligible Speech from Non-invasive Neural Signals with Pretrained Priors29 May 2026
- 2026Measuring Robustness of Speech Recognition from MEG Signals Under Distribution Shift5 Apr 2026
- 2026MEG-to-MEG Transfer Learning and Cross-Task Speech/Silence Detection with Limited Data20 Feb 2026