mlsanityData to 14 Oct 2026

Can Neural Networks Learn by Experimenting on Themselves? Self-Interventional Learning from Functional Consequences to Predictive Self-Knowledge

arXiv 2608.14894 ↗First posted 14 Aug 2026cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Machine-learning systems usually model external data, while their internal functional organization is analyzed by external observers. This work introduces Self-Interventional Learning (SIL), in which a neural system perturbs its own functional structure, observes consequences, learns a predictive self-model, generalizes to unexecuted interventions, and uses predictions to guide later structural action. In a construction-known synthetic system, SIL recovered critical structure, redundancy, and replaceability, while synergy was not reliably recovered. Across 30 fresh confirmatory seeds, increasing the pairwise intervention budget from 4 to 56 reduced held-out prediction error from 0.0335 to 0.0148 and increased Spearman correlation from 0.629 to 0.883. In a matched ablation, preserving the correct intervention--consequence mapping reduced prospective prediction error by 81.3%, while using the same learned self-model for action reduced normalized regret by 31.7% relative to ignoring it. However, model-guided action did not significantly outperform a direct empirical-memory policy, and powered CIFAR-10/ResNet validation showed no robustness advantage over equal-budget direct repair search. These results support SIL as an intervention-driven framework for learning predictive knowledge about a network's own functional organization, while showing that the self-model remains incomplete and is not universally superior to simpler direct strategies.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 21 of its 39 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

21 of 39 references.

References · 21

  1. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  2. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
  3. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
  4. 2018Sanity Checks for Saliency Mapscited by 1,156
  5. 2020Concept Bottleneck Modelscited by 1,032
  6. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
  7. 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 708
  8. 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
  9. 2019Rigging the Lottery: Making All Tickets Winnerscited by 495
  10. 2021Causal Abstractions of Neural Networkscited by 422
  11. 2020Movement Pruning: Adaptive Sparsity by Fine-Tuningcited by 403
  12. 2024How to use and interpret activation patchingcited by 214
9 more
  1. 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 205
  2. 2021Inducing Causal Structure for Interpretable Neural Networkscited by 110
  3. 2022Interventions, Where and How? Experimental Design for Causal Models at Scalecited by 49
  4. 2024InterpBench: Semi-Synthetic Transformers for Evaluating Mechanistic Interpretability Techniquescited by 25
  5. 2025A Comprehensive Survey on Self-Interpretable Neural Networkscited by 18
  6. 2023Differentiable Multi-Target Causal Bayesian Experimental Designcited by 15
  7. 2026The Curse of Multiple Mediators: Hidden Interaction Effects in Activation Patchingcited by 11
  8. 2024Amortized Active Causal Induction with Deep Reinforcement Learningcited by 10
  9. 2022On the Origins of Self-Modelingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.