Data Science with LLMs and Interpretable Models
Not on the map. Why?
Abstract (arXiv)
Recent years have seen important advances in the building of interpretable models, machine learning models that are designed to be easily understood by humans. In this work, we show that large language models (LLMs) are remarkably good at working with interpretable models, too. In particular, we show that LLMs can describe, interpret, and debug Generalized Additive Models (GAMs). Combining the flexibility of LLMs with the breadth of statistical patterns accurately described by GAMs enables dataset summarization, question answering, and model critique. LLMs can also improve the interaction between domain experts and interpretable models, and generate hypotheses about the underlying phenomenon. We release urlhttps://github.com/interpretml/TalkToEBM as an open-source LLM-GAM interface.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 10 of its 24 references that are in the map. First posted on arXiv 22 Feb 2024.
Builds on
10 of 24 references.
References · 10
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2014OpenML: networked science in machine learningcited by 523
- 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 496
- 2022Language Models are Realistic Tabular Data Generatorscited by 290
- 2022Can Foundation Models Wrangle Your Data?cited by 173
- 2020Generalized and Scalable Optimal Sparse Decision Treescited by 98
- 2022From Shapley Values to Generalized Additive Models and backcited by 59
- 2023TabRet: Pre-training Transformer-based Tabular Models for Unseen Columnscited by 14
- 2023LLMs Understand Glass-Box Models, Discover Surprises, and Suggest Repairscited by 7
Built on by
Citing papers per year: 2024: 3; 2025: 3; 2026: 2.
8 papers.
- 2024Data Interpreter: An LLM Agent For Data Sciencecited by 222
- 2024Elephants Never Forget: Memorization and Learning of Tabular Data in Large Language Modelscited by 34
- 2024A Review of Multimodal Explainable Artificial Intelligence: Past, Present and Futurecited by 9
- 2025BIASINSPECTOR: Detecting Bias in Structured Data through LLM Agentscited by 4
- 2025Navigating the Rashomon Effect: How Personalization Can Help Adjust Interpretable Machine Learning Models to Individual Userscited by 0
- 2025The Architecture of Trust: A Framework for AI-Augmented Real Estate Valuation in the Era of Structured Datacited by 0
- 2026Lazy or Efficient? Towards Accessible Eye-Tracking Event Detection Using LLMscited by 0
- 2026Can Conversational XAI Improve User Performance? An Experimental Studycited by 0
- 2026Can Conversational XAI Improve User Performance? An Experimental Study19 May 2026
- 2026Lazy or Efficient? Towards Accessible Eye-Tracking Event Detection Using LLMs14 Apr 2026
- 2025The Architecture of Trust: A Framework for AI-Augmented Real Estate Valuation in the Era of Structured Data4 Aug 2025
- 2025Navigating the Rashomon Effect: How Personalization Can Help Adjust Interpretable Machine Learning Models to Individual Users11 May 2025
- 2025BIASINSPECTOR: Detecting Bias in Structured Data through LLM Agents7 Apr 2025
- 2024A Review of Multimodal Explainable Artificial Intelligence: Past, Present and Future18 Dec 2024
- 2024Elephants Never Forget: Memorization and Learning of Tabular Data in Large Language Models9 Apr 2024
- 2024Data Interpreter: An LLM Agent For Data Science28 Feb 2024