Emulating Non-Differentiable Metrics via Knowledge-Guided Learning: Introducing the Minkowski Image Loss
Not on the map. Why?
Abstract (arXiv)
The ``differentiability gap'' presents a primary bottleneck in Earth system deep learning: since models cannot be trained directly on non-differentiable scientific metrics and must rely on smooth proxies (e.g., MSE), they often fail to capture high-frequency details, yielding ``blurry'' outputs. We develop a framework that bridges this gap using two different methods to deal with non-differentiable functions: the first is to analytically approximate the original non-differentiable function into a differentiable equivalent one; the second is to learn differentiable surrogates for scientific functionals. We formulate the analytical approximation by relaxing discrete topological operations using temperature-controlled sigmoids and continuous logical operators. Conversely, our neural emulator uses Lipschitz-convolutional neural networks to stabilize gradient learning via: (1) spectral normalization to bound the Lipschitz constant; and (2) hard architectural constraints enforcing geometric principles. We demonstrate this framework's utility by developing the Minkowski image loss, a differentiable equivalent for the integral-geometric measures of surface precipitation fields (area, perimeter, connected components). Validated on the EUMETNET OPERA dataset, our constrained neural surrogate achieves high emulation accuracy, completely eliminating the geometric violations observed in unconstrained baselines. However, applying these differentiable surrogates to a deterministic super-resolution task reveals a fundamental trade-off: while strict Lipschitz regularization ensures optimization stability, it inherently over-smooths gradient signals, restricting the recovery of highly localized convective textures. This work highlights the necessity of coupling such topological constraints with stochastic generative architectures to achieve full morphological realism.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
12 of 22 references.
References · 12
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2019Topology-Preserving Deep Image Segmentationcited by 198
- 2016Theory-guided Data Science: A New Paradigm for Scientific Discovery from Datacited by 169
- 2022Improving Lipschitz-Constrained Neural Networks by Learning Activation Functionscited by 23
- 2022Differentiable Programming for Earth System Modelingcited by 21
- 2020Learning Surrogates via Deep Embeddingcited by 11
- 2025Surrogate-Based Differentiable Pipeline for Shape Optimizationcited by 2
- 2026SoftJAX & SoftTorch: Empowering Automatic Differentiation Libraries with Informative Gradientscited by 2
Built on by
Not cited yet.