Interpretable Models for Granger Causality Using Self-explaining Neural Networks
Not on the map. Why?
Abstract (arXiv)
Exploratory analysis of time series data can yield a better understanding of complex dynamical systems. Granger causality is a practical framework for analysing interactions in sequential data, applied in a wide range of domains. In this paper, we propose a novel framework for inferring multivariate Granger causality under nonlinear dynamics based on an extension of self-explaining neural networks. This framework is more interpretable than other neural-network-based techniques for inferring Granger causality, since in addition to relational inference, it also allows detecting signs of Granger-causal effects and inspecting their variability over time. In comprehensive experiments on simulated data, we show that our framework performs on par with several powerful baseline methods at inferring Granger causality and that it achieves better performance at inferring interaction signs. The results suggest that our framework is a viable and more interpretable alternative to sparse-input neural networks for inferring Granger causality.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Builds on 7 of its 51 references that are in the map. First posted on arXiv 19 Jan 2021.
Builds on
7 of 51 references.
References · 7
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2018Neural Relational Inference for Interacting Systemscited by 339
- 2020Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Datacited by 99
- 2019Economy Statistical Recurrent Units For Inferring Nonlinear Granger Causalitycited by 55
- 2018Neural Granger Causalitycited by 19
- 2020Discovering Nonlinear Relations with Minimum Predictive Information Regularizationcited by 16
- 2015Validity of time reversal for testing Granger causalitycited by 4
Built on by
Citing papers per year: 2021: 5; 2022: 7; 2023: 9; 2024: 7; 2025: 12; 2026: 4.
44 papers.
Sort:
- 2022Concept Bottleneck Model with Additional Unsupervised Conceptscited by 79
- 2023Causal Recurrent Variational Autoencoder for Medical Time Series Generationcited by 44
- 2023Causal Discovery from Temporal Data: An Overview and New Perspectivescited by 43
- 2021Neural graphical modelling in continuous-time: consistency guarantees and algorithmscited by 42
- 2023A Survey on Causal Discovery Methods for I.I.D. and Time Series Datacited by 35
- 2021NTS-NOTEARS: Learning Nonparametric DBNs With Prior Knowledgecited by 33
- 2021Transferable Time-Series Forecasting under Causal Conditional Shiftcited by 18
- 2024Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?cited by 17
- 2023Interpretation of Time-Series Deep Models: A Surveycited by 15
- 2022Deep Causal Learning: Representation, Discovery and Inferencecited by 11
- 2022Deep Recurrent Modelling of Granger Causality with Latent Confoundingcited by 8
- 2022Granger causal inference on DAGs identifies genomic loci regulating transcriptioncited by 8
32 more
- 2023Learning the Causal Structure of Networked Dynamical Systems under Latent Nodes and Structured Noisecited by 6
- 2021Learning interaction rules from multi-animal trajectories via augmented behavioral modelscited by 5
- 2024CausalMMM: Learning Causal Structure for Marketing Mix Modelingcited by 5
- 2024Learning Flexible Time-windowed Granger Causality Integrating Heterogeneous Interventional Time Series Datacited by 4
- 2025Unifying Explainable Anomaly Detection and Root Cause Analysis in Dynamical Systemscited by 4
- 2025ClimateBench-M: A Multi-Modal Climate Data Benchmark with a Simple Generative Methodcited by 4
- 2022Granger Causality using Neural Networkscited by 2
- 2025UnCLe: Towards Scalable Dynamic Causal Discovery in Non-linear Temporal Systemscited by 2
- 2022Bayesian Spillover Graphs for Dynamic Networkscited by 1
- 2024Bayesian Vector AutoRegression with Factorised Granger-Causal Graphscited by 1
- 2024OCDB: Revisiting Causal Discovery with a Comprehensive Benchmark and Evaluation Frameworkcited by 1
- 2024Detecting Causality in the Frequency Domain with Cross-Mapping Coherencecited by 1
- 2025Exploring Neural Granger Causality with xLSTMs: Unveiling Temporal Dependencies in Complex Datacited by 1
- 2025Time Series Domain Adaptation via Latent Invariant Causal Mechanismcited by 1
- 2021An Interpretable Neural Network for Parameter Inferencecited by 0
- 2022Jacobian Granger Causal Neural Networks for Analysis of Stationary and Nonstationary Datacited by 0
- 2023Nonlinear Permuted Granger Causalitycited by 0
- 2023Algorithmic Recourse in Abnormal Multivariate Time Seriescited by 0
- 2023Explainable History Distillation by Marked Temporal Point Processcited by 0
- 2023News Signals: An NLP Library for Text and Time Seriescited by 0
- 2024A VAE-based Framework for Learning Multi-Level Neural Granger-Causal Connectivitycited by 0
- 2025Re-examining Granger Causality with Causal Bayesian Networks and Reichenbachs Principlescited by 0
- 2025SpinSVAR: Estimating Structural Vector Autoregression Assuming Sparse Inputcited by 0
- 2025Covariate-dependent Graphical Model Estimation via Neural Networks with Statistical Guaranteescited by 0
- 2025Emergent Granger Causality in Neural Networks: Can Prediction Alone Reveal Structure?cited by 0
- 2025Uncovering Causal Relation Shifts in Event Sequences under Out-of-Domain Interventionscited by 0
- 2025A Gradient-based Causal Discovery Framework with Applications to Complex Industrial Processescited by 0
- 2025Learning Granger Causality under Latent Confounding via Intervention-Induced Heterogeneitycited by 0
- 2026SC3D: Dynamic and Differentiable Causal Discovery for Temporal and Instantaneous Graphscited by 0
- 2026Power Interpretable Causal ODE Networks: A Unified Model for Explainable Anomaly Detection and Root Cause Analysis in Power Systemscited by 0
- 2026Integrating Causal DAGs in Deep RL: Activating Minimal Markovian States with Multi-Order Exposurecited by 0
- 2026Time Series Causal Discovery via Context-Conditioned and Causality-Augmented Pretrainingcited by 0
- 2026Time Series Causal Discovery via Context-Conditioned and Causality-Augmented Pretraining26 May 2026
- 2026Integrating Causal DAGs in Deep RL: Activating Minimal Markovian States with Multi-Order Exposure8 May 2026
- 2026Power Interpretable Causal ODE Networks: A Unified Model for Explainable Anomaly Detection and Root Cause Analysis in Power Systems13 Feb 2026
- 2026SC3D: Dynamic and Differentiable Causal Discovery for Temporal and Instantaneous Graphs2 Feb 2026
- 2025UnCLe: Towards Scalable Dynamic Causal Discovery in Non-linear Temporal Systems5 Nov 2025
- 2025Learning Granger Causality under Latent Confounding via Intervention-Induced Heterogeneity22 Oct 2025
- 2025A Gradient-based Causal Discovery Framework with Applications to Complex Industrial Processes15 Jul 2025
- 2025Uncovering Causal Relation Shifts in Event Sequences under Out-of-Domain Interventions14 Jul 2025
- 2025Emergent Granger Causality in Neural Networks: Can Prediction Alone Reveal Structure?25 Jun 2025
- 2025Covariate-dependent Graphical Model Estimation via Neural Networks with Statistical Guarantees23 Apr 2025
- 2025ClimateBench-M: A Multi-Modal Climate Data Benchmark with a Simple Generative Method10 Apr 2025
- 2025Time Series Domain Adaptation via Latent Invariant Causal Mechanism23 Feb 2025
32 more
- 2025Unifying Explainable Anomaly Detection and Root Cause Analysis in Dynamical Systems17 Feb 2025
- 2025Exploring Neural Granger Causality with xLSTMs: Unveiling Temporal Dependencies in Complex Data14 Feb 2025
- 2025SpinSVAR: Estimating Structural Vector Autoregression Assuming Sparse Input6 Jan 2025
- 2025Re-examining Granger Causality with Causal Bayesian Networks and Reichenbachs Principles5 Jan 2025
- 2024Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?20 Sep 2024
- 2024Detecting Causality in the Frequency Domain with Cross-Mapping Coherence30 Jul 2024
- 2024CausalMMM: Learning Causal Structure for Marketing Mix Modeling24 Jun 2024
- 2024Learning Flexible Time-windowed Granger Causality Integrating Heterogeneous Interventional Time Series Data14 Jun 2024
- 2024OCDB: Revisiting Causal Discovery with a Comprehensive Benchmark and Evaluation Framework7 Jun 2024
- 2024A VAE-based Framework for Learning Multi-Level Neural Granger-Causal Connectivity25 Feb 2024
- 2024Bayesian Vector AutoRegression with Factorised Granger-Causal Graphs6 Feb 2024
- 2023News Signals: An NLP Library for Text and Time Series18 Dec 2023
- 2023Learning the Causal Structure of Networked Dynamical Systems under Latent Nodes and Structured Noise10 Dec 2023
- 2023Explainable History Distillation by Marked Temporal Point Process13 Nov 2023
- 2023Algorithmic Recourse in Abnormal Multivariate Time Series28 Sep 2023
- 2023Nonlinear Permuted Granger Causality11 Aug 2023
- 2023Interpretation of Time-Series Deep Models: A Survey23 May 2023
- 2023A Survey on Causal Discovery Methods for I.I.D. and Time Series Data27 Mar 2023
- 2023Causal Discovery from Temporal Data: An Overview and New Perspectives17 Mar 2023
- 2023Causal Recurrent Variational Autoencoder for Medical Time Series Generation16 Jan 2023
- 2022Deep Causal Learning: Representation, Discovery and Inference7 Nov 2022
- 2022Granger causal inference on DAGs identifies genomic loci regulating transcription18 Oct 2022
- 2022Granger Causality using Neural Networks7 Aug 2022
- 2022Jacobian Granger Causal Neural Networks for Analysis of Stationary and Nonstationary Data19 May 2022
- 2022Bayesian Spillover Graphs for Dynamic Networks3 Mar 2022
- 2022Deep Recurrent Modelling of Granger Causality with Latent Confounding23 Feb 2022
- 2022Concept Bottleneck Model with Additional Unsupervised Concepts3 Feb 2022
- 2021Transferable Time-Series Forecasting under Causal Conditional Shift5 Nov 2021
- 2021NTS-NOTEARS: Learning Nonparametric DBNs With Prior Knowledge9 Sep 2021
- 2021Learning interaction rules from multi-animal trajectories via augmented behavioral models12 Jul 2021
- 2021An Interpretable Neural Network for Parameter Inference10 Jun 2021
- 2021Neural graphical modelling in continuous-time: consistency guarantees and algorithms6 May 2021
- 2022Concept Bottleneck Model with Additional Unsupervised Conceptscited by 79
- 2023Causal Recurrent Variational Autoencoder for Medical Time Series Generationcited by 44
- 2023Causal Discovery from Temporal Data: An Overview and New Perspectivescited by 43
- 2021Neural graphical modelling in continuous-time: consistency guarantees and algorithmscited by 42
- 2023A Survey on Causal Discovery Methods for I.I.D. and Time Series Datacited by 35
- 2021NTS-NOTEARS: Learning Nonparametric DBNs With Prior Knowledgecited by 33
- 2021Transferable Time-Series Forecasting under Causal Conditional Shiftcited by 18
- 2024Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?cited by 17
- 2023Interpretation of Time-Series Deep Models: A Surveycited by 15
- 2022Deep Causal Learning: Representation, Discovery and Inferencecited by 11
- 2022Deep Recurrent Modelling of Granger Causality with Latent Confoundingcited by 8
- 2022Granger causal inference on DAGs identifies genomic loci regulating transcriptioncited by 8
12 most cited of 44 All 44 (JSON)
- 2026Time Series Causal Discovery via Context-Conditioned and Causality-Augmented Pretraining26 May 2026
- 2026Integrating Causal DAGs in Deep RL: Activating Minimal Markovian States with Multi-Order Exposure8 May 2026
- 2026Power Interpretable Causal ODE Networks: A Unified Model for Explainable Anomaly Detection and Root Cause Analysis in Power Systems13 Feb 2026
- 2026SC3D: Dynamic and Differentiable Causal Discovery for Temporal and Instantaneous Graphs2 Feb 2026
- 2025UnCLe: Towards Scalable Dynamic Causal Discovery in Non-linear Temporal Systems5 Nov 2025
- 2025Learning Granger Causality under Latent Confounding via Intervention-Induced Heterogeneity22 Oct 2025
- 2025A Gradient-based Causal Discovery Framework with Applications to Complex Industrial Processes15 Jul 2025
- 2025Uncovering Causal Relation Shifts in Event Sequences under Out-of-Domain Interventions14 Jul 2025
- 2025Emergent Granger Causality in Neural Networks: Can Prediction Alone Reveal Structure?25 Jun 2025
- 2025Covariate-dependent Graphical Model Estimation via Neural Networks with Statistical Guarantees23 Apr 2025
- 2025ClimateBench-M: A Multi-Modal Climate Data Benchmark with a Simple Generative Method10 Apr 2025
- 2025Time Series Domain Adaptation via Latent Invariant Causal Mechanism23 Feb 2025
12 newest of 44 All 44 (JSON)