mlsanityData to 14 Oct 2026

When Are Neural Interaction Discoveries Real? Identifiability, Recoverability, and a Pre-Fit Diagnostic

arXiv 2606.08390 ↗First posted 7 Jun 2026cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

When a neural time-series model reports that one variable modulates another's effect on a target, is the discovered interaction a property of the data or an artifact of model flexibility? We argue that this is fundamentally a question of identifiability, governed by the geometry of the observed input support rather than by the specific neural architecture. We study the problem in a multiplicative-gating extension of neural additive vector autoregression (GNAVAR), in which source contributions are modulated by other lagged variables. We show that representational capacity is not identifiability: dependent inputs induce leakage between edge-specific interaction terms, and low-dimensional support permits distinct interaction decompositions that agree on the observed data while differing elsewhere. We then prove a population identifiability theorem for normalized minimal GNAVAR decompositions under explicit support conditions, including settings with shared modulators. The theory yields a simple practitioner-facing diagnostic: the effective rank of the joint lag-block covariance predicts, before fitting, whether interaction recovery is feasible for a given candidate set. When the candidate set is unknown, a two-seed stability check provides a practical operational test. The same support condition organizes empirical outcomes into the three states predicted by the theory. Our results show that interaction recoverability depends on support geometry, that effective rank provides a practical pre-fit diagnostic, and that instability across independent fits is a characteristic signature of non-identifiable interaction discovery. The identifiability phenomenon, the support condition, and the instability signature are model-agnostic; GNAVAR is the vehicle that makes them provable.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 7 of its 22 references that are in the map. First posted on arXiv 7 Jun 2026.

Builds on

7 of 22 references.

References · 7

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
  3. 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 503
  4. 2018Neural Relational Inference for Interacting Systemscited by 339
  5. 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 282
  6. 2017Detecting Statistical Interactions from Neural Network Weightscited by 80
  7. 2020Neural Additive Vector Autoregression Models for Causal Discovery in Time Seriescited by 28

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.