mlsanityData to 14 Oct 2026

Beyond receptive fields: sequence-pooled normalization can supply most of a sequence labeler's context

arXiv 2608.18576 ↗First posted 19 Aug 2026cs.LG cs.NEcited by 0

Not on the map. Why?

Abstract (arXiv)

A convolutional sequence labeler's receptive field is routinely treated as the extent of the model's usable context: it sets dilation schedules, bounds streaming horizons, and underwrites locality claims. However, we show that this can be false: when a normalization layer computes statistics from the current input along the sequence at inference, those statistics open a sequence-spanning path that bypasses the convolutional receptive field to provide global context. We derive this from the layer's Jacobian (the criterion needs no experiment), and what the path carries has a closed form. On a synthetic labeling process with computable optima, the global summary that a sequence-spanning normalization encodes already supplies almost all of what a larger receptive field would buy where labels come in long runs: a network reaching 9 positions comes within 0.009 of the whole-sequence optimum, against a near-chance bound for its reach. Closing the path, by taking the same statistics per position, multiplies what enlarging the receptive field is worth by up to an order of magnitude on simulated genomes at every difficulty level tested and on real 1000 Genomes haplotypes. The same path also confounds attribution: ablating a trained network's receptive-field-enlarging blocks severs part of the path, overstating their contribution 8.3-16.1-fold relative to retraining from scratch. The substitution of normalization for receptive field fades as labels switch more often. Where labels run long, neither the receptive-field justification nor the ablation is wrong about its numbers, but both credit the wrong component.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 43 references that are in the map. First posted on arXiv 19 Aug 2026.

Builds on

31 of 43 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  4. 2016Layer Normalizationcited by 5,669
  5. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  6. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  7. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  8. 2018Group Normalizationcited by 1,524
  9. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  10. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
  11. 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,133
  12. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
19 more
  1. 2018Rethinking the Value of Network Pruningcited by 599
  2. 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 476
  3. 2020Improving robustness against common corruptions by covariate shift adaptationcited by 431
  4. 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 406
  5. 2019MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentationcited by 373
  6. 2021High-Performance Large-Scale Image Recognition Without Normalizationcited by 360
  7. 2019pyannote.audio: neural building blocks for speaker diarizationcited by 181
  8. 2020How Much Position Information Do Convolutional Neural Networks Encode?cited by 172
  9. 2021ASFormer: Transformer for Action Segmentationcited by 168
  10. 2017DeepSleepNet: a Model for Automatic Sleep Stage Scoring based on Raw Single-Channel EEGcited by 157
  11. 2023The Hydra Effect: Emergent Self-repair in Language Model Computationscited by 156
  12. 2020On Translation Invariance in CNNs: Convolutional Layers can Exploit Absolute Spatial Locationcited by 142
  13. 2018On the importance of single directions for generalizationcited by 99
  14. 2019U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Stagingcited by 88
  15. 2019End-to-End Neural Speaker Diarization with Self-attentioncited by 77
  16. 2020End-to-End Speaker Diarization for an Unknown Number of Speakers with Encoder-Decoder Based Attractorscited by 71
  17. 2019Ablation Studies in Artificial Neural Networkscited by 60
  18. 2021Rethinking "Batch" in BatchNormcited by 45
  19. 2024Optimal ablation for interpretabilitycited by 25

Built on by

Not cited yet.