Can Circuit Alignment Predict OOD Generalization?
Not on the map. Why?
Abstract (arXiv)
Can out-of-distribution (OOD) generalization be predicted from a trained model's weights alone, without any target-domain data? Existing representational similarity metrics (CKA, SVCCA, RSA) compare activations rather than forecast generalization. We show they are provably insensitive to structural rerouting in the computational graph, the very change distribution shift induces. We close this gap with the Circuit Alignment Score (CAS), which compares class-specific circuits across domains via graph kernels, decomposed into same-class coherence and cross-class confusion. Casting CAS as a Lebesgue integral over the domain distribution, we prove its Monte Carlo estimate recovers the ground-truth ranking of learners by OOD accuracy, with pairwise inversion error vanishing at rate O(1/M), where M is the number of sampled domains. Across 48 learners on PACS, CAS attains 0.88 rank correlation with OOD accuracy, versus 0.58 (CKA), 0.23 (SVCCA), and 0.14 (RSA), with similar trends on other benchmarks and even against data-dependent methods, making it the first provably consistent predictor of distributional robustness requiring neither target-domain data nor labels. The code is available at: https://github.com/ayanban011/ACE
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 69 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
43 of 69 references.
References · 43
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2019Invariant Risk Minimizationcited by 1,854
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,331
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
- 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,188
31 more
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
- 2020In Search of Lost Domain Generalizationcited by 1,054
- 2017Deeper, Broader and Artier Domain Generalizationcited by 986
- 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
- 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 359
- 2023Data Selection for Language Models via Importance Resamplingcited by 329
- 2019Adversarial Domain Adaptation with Domain Mixupcited by 250
- 2016Deep Learning without Poor Local Minimacited by 234
- 2023Attribution Patching Outperforms Automated Circuit Discoverycited by 209
- 2025Open Problems in Mechanistic Interpretabilitycited by 179
- 2022Leveraging Unlabeled Data to Predict Out-of-Distribution Performancecited by 145
- 2018Predicting the Generalization Gap in Deep Networks with Margin Distributionscited by 113
- 2021Towards a Theoretical Framework of Out-of-Distribution Generalizationcited by 94
- 2022Agreement-on-the-Line: Predicting the Performance of Neural Networks under Distribution Shiftcited by 94
- 2022PAC-Bayes Compression Bounds So Tight That They Can Explain Generalizationcited by 76
- 2019GOT: An Optimal Transport framework for Graph comparisoncited by 64
- 2020Empirical or Invariant Risk Minimization? A Sample Complexity Perspectivecited by 62
- 2023Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIPcited by 62
- 2025Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignmentcited by 62
- 2018GraKeL: A Graph Kernel Library in Pythoncited by 54
- 2022Predicting Out-of-Distribution Error with the Projection Normcited by 50
- 2023Multimodal Neurons in Pretrained Text-Only Transformerscited by 49
- 2022Out-of-distribution Generalization with Causal Invariant Transformationscited by 45
- 2023Understanding and Improving Feature Learning for Out-of-Distribution Generalizationcited by 35
- 2022Modeling the Data-Generating Process is Necessary for Out-of-Distribution Generalizationcited by 34
- 2019Screening Sinkhorn Algorithm for Regularized Optimal Transportcited by 20
- 2021Out-of-Distribution Generalization Analysis via Influence Functioncited by 11
- 2017Stochastic Graphlet Embeddingcited by 9
- 2024MADOD: Generalizing OOD Detection to Unseen Domains via G-Invariance Meta-Learningcited by 5
- 2023Input margins can predict generalization toocited by 4
- 2025How good is PAC-Bayes at explaining generalisation?cited by 4
Built on by
Not cited yet.