mlsanityData to 14 Oct 2026

LearnLM: Improving Gemini for Learning

arXiv 2412.16429 ↗First posted 21 Dec 2024cs.CY cs.AI cs.LGcited by 25

Not on the map. Why?

Abstract (arXiv)

Today's generative AI systems are tuned to present information by default, rather than engage users in service of learning as a human tutor would. To address the wide range of potential education use cases for these systems, we reframe the challenge of injecting pedagogical behavior as one of textitpedagogical instruction following, where training and evaluation examples include system-level instructions describing the specific pedagogy attributes present or desired in subsequent model turns. This framing avoids committing our models to any particular definition of pedagogy, and instead allows teachers or developers to specify desired model behavior. It also clears a path to improving Gemini models for learning -- by enabling the addition of our pedagogical data to post-training mixtures -- alongside their rapidly expanding set of capabilities. Both represent important changes from our initial tech report. We show how training with pedagogical instruction following produces a LearnLM model (available on Google AI Studio) that experts substantially prefer across a diverse set of learning scenarios, with average preference strengths of +31% over GPT-4o, +11% over Claude 3.5 Sonnet, and +13% over the Gemini 1.5 Pro model on which LearnLM was based.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 12 of its 25 references that are in the map. First posted on arXiv 21 Dec 2024.

Builds on

12 of 25 references.

References · 12

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  3. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  4. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
  5. 2024Benchmarking Complex Instruction-Following with Multiple Constraints Compositioncited by 152
  6. 2024InFoBench: Evaluating Instruction Following Ability in Large Language Modelscited by 135
  7. 2024Towards Responsible Development of Generative AI for Education: An Evaluation-Driven Approachcited by 54
  8. 2024Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertisecited by 50
  9. 2024Towards interactive evaluations for interaction harms in human-AI systemscited by 29
  10. 2023Assigning AI: Seven Approaches for Students, with Promptscited by 16
  11. 2023Human participants in AI research: Ethics and transparency in practicecited by 6
  12. 2023Teaching and learning in the age of artificial intelligencecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 14; 2026: 11.

25 papers.

Sort:

By area:

  1. 2025LLMs are Greedy Agents: Effects of RL Fine-tuning on Decision-Making Abilitiescited by 41
  2. 2025EmoBench-M: Benchmarking Emotional Intelligence for Multimodal Large Language Modelscited by 32
  3. 2025WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMscited by 26
  4. 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Modelscited by 25
  5. 2025Multimodal Large Language Models Meet Multimodal Emotion Recognition and Reasoning: A Surveycited by 19
  6. 2025Evaluating Gemini in an arena for learningcited by 11
  7. 2025Benchmarking the Pedagogical Knowledge of Large Language Modelscited by 5
  8. 2025Pedagogy-driven Evaluation of Generative AI-powered Intelligent Tutoring Systemscited by 5
  9. 2026FoundationalASSIST: An Educational Dataset for Foundational Knowledge Tracing and Pedagogical Grounding of LLMscited by 4
  10. 2025AI tutoring can safely and effectively support students: An exploratory RCT in UK classroomscited by 3
  11. 2025Causality Is Key to Understand and Balance Multiple Goals in Trustworthy ML and Foundation Modelscited by 2
  12. 2025A Framework for Situating Innovations, Opportunities, and Challenges in Advancing Vertical Systems with Large AI Modelscited by 2
13 more
  1. 2026Large Language Models as Students Who Think Aloud: Overly Coherent, Verbose, and Confidentcited by 2
  2. 2025The Imitation Game for Educational AIcited by 1
  3. 2025Language Bottleneck Models for Qualitative Knowledge State Modelingcited by 1
  4. 2025Cultivating Helpful, Personalized, and Creative AI Tutors: A Framework for Pedagogical Alignment using Reinforcement Learningcited by 1
  5. 2026Hey Chat, Can You Teach Me? Structuring Socratic Dialogue for Human Learning in the Wildcited by 1
  6. 2026Rethinking LLM-Judged Helpfulness as a Pedagogy Signal: A Pre-Registered Audit Across Tutor Modelscited by 1
  7. 2026Integrating Fine-Grained Audio-Visual Evidence for Robust Multimodal Emotion Reasoningcited by 0
  8. 2026ISD-Agent-Bench: A Comprehensive Benchmark for Evaluating LLM-based Instructional Design Agentscited by 0
  9. 2026Sycophancy is an Educational Safety Risk: Why LLM Tutors Need Sycophancy Benchmarkscited by 0
  10. 2026ConnectED: A Curriculum-Aligned AI System for Vietnamese Instructional Lesson Planning and Student Learningcited by 0
  11. 2026Auditable Release Control for Pedagogical Leakage in LLM Tutorscited by 0
  12. 2026Difference-in-Differences on a Censored Rating Scale Can Manufacture an Effect: Evidence from a Pre-Registered LLM-Judge Auditcited by 0
  13. 2026Sherpa: Teaching LLMs to Teach Adaptivelycited by 0