mlsanityData to 14 Oct 2026

GRAFT: Gain-Recalibrated Adapters for Transformer-Based Neural Population Activity Modeling

arXiv 2606.11066 ↗First posted 9 Jun 2026cs.LG q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural population activity models can recover rich temporal structure from binned spikes, but their read-in and readout layers often remain tied to a fixed set of recorded neurons. This coupling limits reuse in long-term brain-computer interfaces, where recorded neuron identities, counts, and response statistics can change across days. We introduce GRAFT, a Transformer-based neural population activity model that separates reusable temporal dynamics from a recalibratable neuron interface. The neuron interface controls how recorded neurons enter and leave the shared backbone, and auxiliary gain and positional mechanisms support neural activity modeling inside the Transformer. On MC Maze under the standard NLB'21 protocol, GRAFT reaches 0.3866 co-bps as an ensemble, setting a new state of the art on the primary co-bps metric among public and reported NLB'21 results. In a cross-day protocol constructed from the NLB'21 MC Maze dataset series, GRAFT recalibrates from MC Maze to the scaled MC Maze datasets (Large/Medium/Small) by updating only 9.21% of parameters, reaching 0.3749, 0.3112, and 0.3152 co-bps with restricted target-day support sets. These results show that the same interface-backbone separation supports both strong Transformer-based neural population activity modeling and data-efficient cross-day recalibration.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 18 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

4 of 18 references.

References · 4

  1. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,103
  2. 2022Simplified State Space Layers for Sequence Modelingcited by 788
  3. 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 283
  4. 2021Neural Latents Benchmark '21: Evaluating latent variable models of neural population activitycited by 60

Built on by

Not cited yet.