Attributing Preprocessing Invariance in Spectral Foundation Models
Not on the map. Why?
Abstract (arXiv)
A spectral foundation model should remain useful when laboratories preprocess spectra differently. The standard test trains a classifier under one pipeline and evaluates under another, taking preserved accuracy as evidence of learned invariance. However, these models normalize each input before any learned parameter is applied. When normalization maps differently preprocessed spectra to the same vector, the encoder receives identical inputs and the measured invariance cannot be attributed to learning. We propose a normalization-only attribution control: compare the encoder against its normalization before interpreting transfer as learned invariance. On six Raman datasets the encoder does not measurably improve transfer over its normalization. A controlled experiment confirms invariance develops only when variation reaches the encoder past normalization. Across three systems, no encoder improves relative retention over its normalization. An audit of eighteen configurations across five modalities confirms the issue is widespread: the normalization-only control should be reported before crediting transfer to the encoder.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 40 references that are in the map. First posted on arXiv 14 Aug 2026.
Builds on
23 of 40 references.
References · 23
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
- 2024Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCIcited by 311
- 2021BENDR: using transformers and a contrastive self-supervised learning task to learn from massive amounts of EEG datacited by 194
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
11 more
- 2021Generalized Shape Metrics on Neural Representationscited by 109
- 2024ECG-FM: An Open Electrocardiogram Foundation Modelcited by 89
- 2024Guiding Masked Representation Learning to Capture Spatio-Temporal Relationship of Electrocardiogramcited by 84
- 2022Reliability of CKA as a Similarity Measure in Deep Learningcited by 82
- 2024PaPaGei: Open Foundation Models for Optical Physiological Signalscited by 64
- 2025Pulse-PPG: An Open-Source Field-Trained PPG Foundation Model for Wearable Applications Across Lab and Field Settingscited by 35
- 2017Deep Convolutional Neural Networks for Raman Spectrum Recognition: A Unified Solutioncited by 25
- 2017Data Augmentation of Spectral Data for Convolutional Neural Network (CNN) Based Deep Chemometricscited by 6
- 2026RamanBench: A Large-Scale Benchmark for Machine Learning on Raman Spectroscopycited by 3
- 2019Optimized Preprocessing and Machine Learning for Quantitative Raman Spectroscopy in Biologycited by 1
- 2026RamanPFN: learning from Raman spectral structure with a tabular foundation modelcited by 1
Built on by
Not cited yet.