LearnLM: Improving Gemini for Learning
Not on the map. Why?
Abstract (arXiv)
Today's generative AI systems are tuned to present information by default, rather than engage users in service of learning as a human tutor would. To address the wide range of potential education use cases for these systems, we reframe the challenge of injecting pedagogical behavior as one of textitpedagogical instruction following, where training and evaluation examples include system-level instructions describing the specific pedagogy attributes present or desired in subsequent model turns. This framing avoids committing our models to any particular definition of pedagogy, and instead allows teachers or developers to specify desired model behavior. It also clears a path to improving Gemini models for learning -- by enabling the addition of our pedagogical data to post-training mixtures -- alongside their rapidly expanding set of capabilities. Both represent important changes from our initial tech report. We show how training with pedagogical instruction following produces a LearnLM model (available on Google AI Studio) that experts substantially prefer across a diverse set of learning scenarios, with average preference strengths of +31% over GPT-4o, +11% over Claude 3.5 Sonnet, and +13% over the Gemini 1.5 Pro model on which LearnLM was based.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 12 of its 25 references that are in the map. First posted on arXiv 21 Dec 2024.
Builds on
12 of 25 references.
References · 12
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
- 2024Benchmarking Complex Instruction-Following with Multiple Constraints Compositioncited by 152
- 2024InFoBench: Evaluating Instruction Following Ability in Large Language Modelscited by 135
- 2024Towards Responsible Development of Generative AI for Education: An Evaluation-Driven Approachcited by 54
- 2024Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertisecited by 50
- 2024Towards interactive evaluations for interaction harms in human-AI systemscited by 29
- 2023Assigning AI: Seven Approaches for Students, with Promptscited by 16
- 2023Human participants in AI research: Ethics and transparency in practicecited by 6
- 2023Teaching and learning in the age of artificial intelligencecited by 1
Built on by
Citing papers per year: 2025: 14; 2026: 11.
25 papers.
Sort:
By area:
- 2025LLMs are Greedy Agents: Effects of RL Fine-tuning on Decision-Making Abilitiescited by 41
- 2025EmoBench-M: Benchmarking Emotional Intelligence for Multimodal Large Language Modelscited by 32
- 2025WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMscited by 26
- 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Modelscited by 25
- 2025Multimodal Large Language Models Meet Multimodal Emotion Recognition and Reasoning: A Surveycited by 19
- 2025Evaluating Gemini in an arena for learningcited by 11
- 2025Benchmarking the Pedagogical Knowledge of Large Language Modelscited by 5
- 2025Pedagogy-driven Evaluation of Generative AI-powered Intelligent Tutoring Systemscited by 5
- 2026FoundationalASSIST: An Educational Dataset for Foundational Knowledge Tracing and Pedagogical Grounding of LLMscited by 4
- 2025AI tutoring can safely and effectively support students: An exploratory RCT in UK classroomscited by 3
- 2025Causality Is Key to Understand and Balance Multiple Goals in Trustworthy ML and Foundation Modelscited by 2
- 2025A Framework for Situating Innovations, Opportunities, and Challenges in Advancing Vertical Systems with Large AI Modelscited by 2
13 more
- 2026Large Language Models as Students Who Think Aloud: Overly Coherent, Verbose, and Confidentcited by 2
- 2025The Imitation Game for Educational AIcited by 1
- 2025Language Bottleneck Models for Qualitative Knowledge State Modelingcited by 1
- 2025Cultivating Helpful, Personalized, and Creative AI Tutors: A Framework for Pedagogical Alignment using Reinforcement Learningcited by 1
- 2026Hey Chat, Can You Teach Me? Structuring Socratic Dialogue for Human Learning in the Wildcited by 1
- 2026Rethinking LLM-Judged Helpfulness as a Pedagogy Signal: A Pre-Registered Audit Across Tutor Modelscited by 1
- 2026Integrating Fine-Grained Audio-Visual Evidence for Robust Multimodal Emotion Reasoningcited by 0
- 2026ISD-Agent-Bench: A Comprehensive Benchmark for Evaluating LLM-based Instructional Design Agentscited by 0
- 2026Sycophancy is an Educational Safety Risk: Why LLM Tutors Need Sycophancy Benchmarkscited by 0
- 2026ConnectED: A Curriculum-Aligned AI System for Vietnamese Instructional Lesson Planning and Student Learningcited by 0
- 2026Auditable Release Control for Pedagogical Leakage in LLM Tutorscited by 0
- 2026Difference-in-Differences on a Censored Rating Scale Can Manufacture an Effect: Evidence from a Pre-Registered LLM-Judge Auditcited by 0
- 2026Sherpa: Teaching LLMs to Teach Adaptivelycited by 0
- 2026Sherpa: Teaching LLMs to Teach Adaptively6 Oct 2026
- 2026Difference-in-Differences on a Censored Rating Scale Can Manufacture an Effect: Evidence from a Pre-Registered LLM-Judge Audit27 Aug 2026
- 2026Auditable Release Control for Pedagogical Leakage in LLM Tutors1 Aug 2026
- 2026Rethinking LLM-Judged Helpfulness as a Pedagogy Signal: A Pre-Registered Audit Across Tutor Models30 Jul 2026
- 2026Hey Chat, Can You Teach Me? Structuring Socratic Dialogue for Human Learning in the Wild10 Jun 2026
- 2026ConnectED: A Curriculum-Aligned AI System for Vietnamese Instructional Lesson Planning and Student Learning2 Jun 2026
- 2026Sycophancy is an Educational Safety Risk: Why LLM Tutors Need Sycophancy Benchmarks14 May 2026
- 2026ISD-Agent-Bench: A Comprehensive Benchmark for Evaluating LLM-based Instructional Design Agents11 Feb 2026
- 2026Large Language Models as Students Who Think Aloud: Overly Coherent, Verbose, and Confident1 Feb 2026
- 2026Integrating Fine-Grained Audio-Visual Evidence for Robust Multimodal Emotion Reasoning26 Jan 2026
- 2026FoundationalASSIST: An Educational Dataset for Foundational Knowledge Tracing and Pedagogical Grounding of LLMs20 Jan 2026
- 2025AI tutoring can safely and effectively support students: An exploratory RCT in UK classrooms29 Dec 2025
13 more
- 2025Pedagogy-driven Evaluation of Generative AI-powered Intelligent Tutoring Systems26 Oct 2025
- 2025Multimodal Large Language Models Meet Multimodal Emotion Recognition and Reasoning: A Survey29 Sep 2025
- 2025Cultivating Helpful, Personalized, and Creative AI Tutors: A Framework for Pedagogical Alignment using Reinforcement Learning27 Jul 2025
- 2025Benchmarking the Pedagogical Knowledge of Large Language Models23 Jun 2025
- 2025Language Bottleneck Models for Qualitative Knowledge State Modeling20 Jun 2025
- 2025Evaluating Gemini in an arena for learning30 May 2025
- 2025LLMs are Greedy Agents: Effects of RL Fine-tuning on Decision-Making Abilities22 Apr 2025
- 2025A Framework for Situating Innovations, Opportunities, and Challenges in Advancing Vertical Systems with Large AI Models3 Apr 2025
- 2025WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMs7 Mar 2025
- 2025Causality Is Key to Understand and Balance Multiple Goals in Trustworthy ML and Foundation Models28 Feb 2025
- 2025The Imitation Game for Educational AI21 Feb 2025
- 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models10 Feb 2025
- 2025EmoBench-M: Benchmarking Emotional Intelligence for Multimodal Large Language Models6 Feb 2025
- 2025Multimodal Large Language Models Meet Multimodal Emotion Recognition and Reasoning: A Surveycited by 19
- 2026Large Language Models as Students Who Think Aloud: Overly Coherent, Verbose, and Confidentcited by 2
- 2026Rethinking LLM-Judged Helpfulness as a Pedagogy Signal: A Pre-Registered Audit Across Tutor Modelscited by 1
- 2026Integrating Fine-Grained Audio-Visual Evidence for Robust Multimodal Emotion Reasoningcited by 0
- 2026Rethinking LLM-Judged Helpfulness as a Pedagogy Signal: A Pre-Registered Audit Across Tutor Models30 Jul 2026
- 2026Large Language Models as Students Who Think Aloud: Overly Coherent, Verbose, and Confident1 Feb 2026
- 2026Integrating Fine-Grained Audio-Visual Evidence for Robust Multimodal Emotion Reasoning26 Jan 2026
- 2025Multimodal Large Language Models Meet Multimodal Emotion Recognition and Reasoning: A Survey29 Sep 2025
- 2025WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMscited by 26
- 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Modelscited by 25
- 2025Evaluating Gemini in an arena for learningcited by 11
- 2025Benchmarking the Pedagogical Knowledge of Large Language Modelscited by 5
- 2025Pedagogy-driven Evaluation of Generative AI-powered Intelligent Tutoring Systemscited by 5
- 2026FoundationalASSIST: An Educational Dataset for Foundational Knowledge Tracing and Pedagogical Grounding of LLMscited by 4
- 2025AI tutoring can safely and effectively support students: An exploratory RCT in UK classroomscited by 3
- 2025Causality Is Key to Understand and Balance Multiple Goals in Trustworthy ML and Foundation Modelscited by 2
- 2025A Framework for Situating Innovations, Opportunities, and Challenges in Advancing Vertical Systems with Large AI Modelscited by 2
- 2025The Imitation Game for Educational AIcited by 1
- 2025Language Bottleneck Models for Qualitative Knowledge State Modelingcited by 1
- 2026Hey Chat, Can You Teach Me? Structuring Socratic Dialogue for Human Learning in the Wildcited by 1
12 most cited of 16 All 16 (JSON)
- 2026Sherpa: Teaching LLMs to Teach Adaptively6 Oct 2026
- 2026Difference-in-Differences on a Censored Rating Scale Can Manufacture an Effect: Evidence from a Pre-Registered LLM-Judge Audit27 Aug 2026
- 2026Auditable Release Control for Pedagogical Leakage in LLM Tutors1 Aug 2026
- 2026Hey Chat, Can You Teach Me? Structuring Socratic Dialogue for Human Learning in the Wild10 Jun 2026
- 2026Sycophancy is an Educational Safety Risk: Why LLM Tutors Need Sycophancy Benchmarks14 May 2026
- 2026FoundationalASSIST: An Educational Dataset for Foundational Knowledge Tracing and Pedagogical Grounding of LLMs20 Jan 2026
- 2025AI tutoring can safely and effectively support students: An exploratory RCT in UK classrooms29 Dec 2025
- 2025Pedagogy-driven Evaluation of Generative AI-powered Intelligent Tutoring Systems26 Oct 2025
- 2025Benchmarking the Pedagogical Knowledge of Large Language Models23 Jun 2025
- 2025Language Bottleneck Models for Qualitative Knowledge State Modeling20 Jun 2025
- 2025Evaluating Gemini in an arena for learning30 May 2025
- 2025A Framework for Situating Innovations, Opportunities, and Challenges in Advancing Vertical Systems with Large AI Models3 Apr 2025
12 newest of 16 All 16 (JSON)