FrED: External Data Influence Estimation via Domain Knowledge Graph Grounding
Not on the map. Why?
Abstract (arXiv)
The rapid deployment of generative AI has amplified the critical need for Training Data Attribution to ensure transparency and accountability. However, current parametric approaches require computationally prohibitive access to model weights, while similarity-based methods ignore deep structural context. We propose a novel probabilistic framework that operates entirely in a black-box setting. Our method fuses continuous feature similarities with discrete, domain-specific Knowledge Graphs (KGs). This approach ensures the attribution is grounded in structural reality, explicitly rewarding highly specific historical samples while preventing generic background data from dominating the results. We evaluate our framework across two distinct domains where linking outputs to data and domain context is inherently complex: abstract artistic image synthesis and high-dimensional physical weather forecasting. Extensive benchmarking demonstrates the robust efficacy of our approach. In the artistic domain, it achieves a strong Linear Datamodeling Score that exceeds standard black-box similarity baselines, while closing much of the gap to gradient-based estimators. We additionally present a cross-domain feasibility case study in environmental forecasting, where we use domain KGs to retrieve physically consistent historical analogs for regional flood forecasts, improving geographic localisation over a latent-only baseline. Operating entirely without internal model access, our approach provides an efficient, interpretable mechanism for post-hoc influence analysis and domain-grounded retrieval.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
23 of 37 references.
References · 23
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
- 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 565
- 2023TRAK: Attributing Model Behavior at Scalecited by 273
- 2019The Shapley Taylor Interaction Indexcited by 143
- 2022Training Data Influence Analysis and Estimation: A Surveycited by 134
- 2021Input Similarity from the Neural Network Perspectivecited by 78
11 more
- 2022The ArtBench Dataset: Benchmarking Generative Models with Artworkscited by 64
- 2023Intriguing Properties of Data Attribution on Diffusion Modelscited by 47
- 2023Evaluating Data Attribution for Text-to-Image Modelscited by 45
- 2023The Journey, Not the Destination: How Data Guides Diffusion Modelscited by 42
- 2021Leave-one-out Unfairnesscited by 36
- 2022Identifying a Training-Set Attack's Target Using Renormalized Influence Estimationcited by 32
- 2024Data Attribution for Text-to-Image Models by Unlearning Synthesized Imagescited by 22
- 2024Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Modelscited by 21
- 2025Fast Data Attribution for Text-to-Image Modelscited by 7
- 2025Enhancing Interpretability in Generative AI Through Search-Based Data Influence Analysiscited by 1
- 2025Training Data Attribution for Image Generation using Ontology-Aligned Knowledge Graphscited by 1
Built on by
Not cited yet.