mlsanityData to 14 Oct 2026

The Normalized Difference Layer: A Differentiable Spectral Index Formulation for Deep Learning

arXiv 2601.06777 ↗First posted 11 Jan 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Normalized difference indices have been a staple in remote sensing for decades. They stay reliable under lighting changes produce bounded values and connect well to biophysical signals. Even so, they are usually treated as a fixed pre processing step with coefficients set to one, which limits how well they can adapt to a specific learning task. In this study, we introduce the Normalized Difference Layer that is a differentiable neural network module. The proposed method keeps the classical idea but learns the band coefficients from data. We present a complete mathematical framework for integrating this layer into deep learning architectures that uses softplus reparameterization to ensure positive coefficients and bounded denominators. We describe forward and backward pass algorithms enabling end to end training through backpropagation. This approach preserves the key benefits of normalized differences, namely illumination invariance and outputs bounded to [-1,1] while allowing gradient descent to discover task specific band weightings. We extend the method to work with signed inputs, so the layer can be stacked inside larger architectures. Experiments show that models using this layer reach similar classification accuracy to standard multilayer perceptrons while using about 75% fewer parameters. They also handle multiplicative noise well, at 10% noise accuracy drops only 0.17% versus 3.03% for baseline MLPs. The learned coefficient patterns stay consistent across different depths.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 60 references that are in the map. First posted on arXiv 11 Jan 2026.

Builds on

12 of 60 references.

References · 12

  1. 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
  2. 2020Neural Additive Models: Interpretable Machine Learning with Neural Netscited by 319
  3. 2020Rational neural networkscited by 75
  4. 2023Approximation-Generalization Trade-offs under (Approximate) Group Equivariancecited by 46
  5. 2016Generalization Error of Invariant Classifierscited by 42
  6. 2019Improved Generalization Bounds of Group Invariant / Equivariant Deep Networks via Quotient Feature Spacescited by 34
  7. 2023Normalization-Equivariant Neural Networks with Application to Image Denoisingcited by 11
  8. 2024EuroCropsML: A Time Series Benchmark Dataset For Few-Shot Crop Type Classificationcited by 11
  9. 2020DeepCoDA: personalized interpretability for compositional health datacited by 7
  10. 2024Probabilistic Analysis of Least Squares, Orthogonal Projection, and QR Factorization Algorithms Subject to Gaussian Noisecited by 1
  11. 2025Normalize Filters! Classical Wisdom for Deep Visioncited by 1
  12. 2025Interpretable Machine Learning-Derived Spectral Indices for Vegetation Monitoringcited by 1

Built on by

Not cited yet.