Shaping Scientific Explanations to Expert Perspectives with Persona-Conditioned Reinforcement Learning
On the map: Deep reinforcement learning methods → RL training of language and agent models
Abstract (arXiv)
Explainable AI is increasingly important to scientific discovery. However, existing methods largely ignore that explanation quality is not universal: experts differ in how they assess evidence, prioritize mechanisms, and construct explanatory narratives. We introduce perspective-conditioned explanations, a framework for adapting explanation generation to epistemic variation in expert judgment. Using knowledge graph reasoning paths in drug discovery, we show that preferences organize into coherent epistemic perspectives that can be captured by agentic personas, representations of how experts evaluate explanations. Persona-aligned rewards then guide reinforcement learning-based explanation generation without large-scale expert supervision. Expert user studies show that perspective-conditioned explanations are preferred over general-purpose explanations and improve perceived relevance and validity. Moreover, they match or exceed state-of-the-art predictive performance and reduce expert feedback time by two orders of magnitude. Together, these findings demonstrate that explanation quality is perspective-dependent and that modeling this variation enables scalable and human-aligned explanation generation for scientific discovery.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 14 of its 40 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
14 of 40 references.
References · 14
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
- 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 266
- 2017Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learningcited by 161
- 2020Drug discovery with explainable artificial intelligencecited by 118
- 2022TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversationscited by 66
- 2021Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needscited by 64
- 2020OWL2Vec*: Embedding of OWL Ontologiescited by 63
- 2021Neural Multi-Hop Reasoning With Logical Rules on Biomedical Knowledge Graphscited by 25
- 2022Explainable Artificial Intelligence (XAI) from a user perspective- A synthesis of prior literature and problematizing avenues for future researchcited by 20
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2020Order Matters: Generating Progressive Explanations for Planning Tasks in Human-Robot Teaming
- 2025Unlearning as Ablation: Toward a Falsifiable Benchmark for Generative Scientific Discovery
- 2026Debate as Reward: A Multi-Agent Reward System for Scientific Ideation via RL Post-Training
- 2025Evaluating Explanations: An Explanatory Virtues Framework for Mechanistic Interpretability -- The Strange Science Part I.ii
- 2024AI Knowledge and Reasoning: Emulating Expert Creativity in Scientific Research
- 2026EvoSCM: Scientific Belief Revision Through Causal Model Evolution and Experimentation
- 2026LLM-Guided Monte Carlo Tree Search over Knowledge Graphs: Composing Mechanistic Explanations for Drug-Disease Pairs
- 2025Learning to Construct Knowledge through Sparse Reference Selection with Reinforcement Learning