DSAI: Unbiased and Interpretable Latent Feature Extraction for Data-Centric AI
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) often struggle to objectively identify latent characteristics in large datasets due to their reliance on pre-trained knowledge rather than actual data patterns. To address this data grounding issue, we propose Data Scientist AI (DSAI), a framework that enables unbiased and interpretable feature extraction through a multi-stage pipeline with quantifiable prominence metrics for evaluating extracted features. On synthetic datasets with known ground-truth features, DSAI demonstrates high recall in identifying expert-defined features while faithfully reflecting the underlying data. Applications on real-world datasets illustrate the framework's practical utility in uncovering meaningful patterns with minimal expert oversight, supporting use cases such as interpretable classification. The title of our paper is chosen from multiple candidates based on DSAI-generated criteria.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 26 references that are in the map. First posted on arXiv 9 Dec 2024.
Builds on
15 of 26 references.
References · 15
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2024ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidencecited by 109
- 2023Branch-Solve-Merge Improves Large Language Model Evaluation and Generationcited by 104
- 2024Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooMcited by 77
- 2023Large Language Models Enable Few-Shot Clusteringcited by 72
- 2023Goal-Driven Explainable Clustering via Language Descriptionscited by 58
- 2023In-Context Learning Learns Label Relationships but Is Not Conventional Learningcited by 48
- 2024HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decompositioncited by 33
- 2023Image Clustering Conditioned on Text Criteriacited by 26
- 2024Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)cited by 20
3 more
Built on by
Not cited yet.