Using Machine Learning to Discover Parsimonious and Physically-Interpretable Representations of Catchment-Scale Rainfall-Runoff Dynamics
Not on the map. Why?
Abstract (arXiv)
Due largely to challenges associated with physical interpretability of machine learning (ML) methods, and because model interpretability is key to credibility in management applications, many scientists and practitioners are hesitant to discard traditional physical-conceptual (PC) modeling approaches despite their poorer predictive performance. Here, we examine how to develop parsimonious minimally-optimal representations that can facilitate better insight regarding system functioning. The term minimally-optimal indicates that the desired outcome can be achieved with the smallest possible effort and resources, while parsimony is widely held to support understanding. Accordingly, we suggest that ML-based modeling should use computational units that are inherently physically-interpretable, and explore how generic network architectures comprised of Mass-Conserving-Perceptron can be used to model dynamical systems in a physically-interpretable manner. In the context of spatially-lumped catchment-scale modeling, we find that both physical interpretability and good predictive performance can be achieved using a distributed-state network with context-dependent gating and information sharing across nodes. The distributed-state mechanism ensures a sufficient number of temporally-evolving properties of system storage while information-sharing ensures proper synchronization of such properties. The results indicate that MCP-based ML models with only a few layers (up to two) and relativity few physical flow pathways (up to three) can play a significant role in ML-based streamflow modelling.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 28 of its 133 references that are in the map. First posted on arXiv 6 Dec 2024.
Builds on
28 of 133 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2016HyperNetworkscited by 1,003
- 2015Automatic differentiation in machine learning: a surveycited by 846
- 2015Deep Learning and the Information Bottleneck Principlecited by 793
- 2024KAN: Kolmogorov-Arnold Networkscited by 634
- 2020What is the State of Neural Network Pruning?cited by 578
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
16 more
- 2020Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systemscited by 160
- 2024KAN 2.0: Kolmogorov-Arnold Networks Meet Sciencecited by 116
- 2017A trans-disciplinary review of deep learning research for water resources scientistscited by 47
- 2022Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equationscited by 42
- 2019Enhancing streamflow forecast and extracting insights using long-short term memory networks with data integration at continental scalescited by 27
- 2020From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modelingcited by 26
- 2021Network Augmentation for Tiny Deep Learningcited by 23
- 2021Minimum Description Length Recurrent Neural Networkscited by 23
- 2022Differentiable, learnable, regionalized process-based models with physical outputs can approach state-of-the-art hydrologic prediction accuracycited by 21
- 2021MC-LSTM: Mass-Conserving LSTMcited by 17
- 2021Nowcasting-Nets: Deep Neural Network Structures for Precipitation Nowcasting Using IMERGcited by 10
- 2020Rainfall-Runoff Prediction at Multiple Timescales with a Single Long Short-Term Memory Networkcited by 6
- 2023A Mass-Conserving-Perceptron for Machine Learning-Based Modeling of Geoscientific Systemscited by 6
- 2023Temporal Fusion Transformers for Streamflow Prediction: Value of Combining Attention with Recurrencecited by 4
- 2024Towards Interpretable Physical-Conceptual Catchment-Scale Hydrological Modeling using the Mass-Conserving-Perceptroncited by 4
- 2024Baseflow identification via explainable AI with Kolmogorov-Arnold networkscited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Scientific machine learning in Hydrology: a unified perspectivecited by 0
- 2026Process-Aware AI for Rainfall-Runoff Modeling: A Mass-Conserving Neural Framework with Hydrological Process Constraintscited by 0
- 2026Improving Model Performance by Adapting the KGE Metric to Account for System Non-Stationaritycited by 0
- 2026Improving Model Performance by Adapting the KGE Metric to Account for System Non-Stationarity5 Apr 2026
- 2026Process-Aware AI for Rainfall-Runoff Modeling: A Mass-Conserving Neural Framework with Hydrological Process Constraints26 Mar 2026
- 2025Scientific machine learning in Hydrology: a unified perspective24 May 2025