Machine Teaching: A New Paradigm for Building Machine Learning Systems
Not on the map. Why?
Abstract (arXiv)
The current processes for building machine learning systems require practitioners with deep knowledge of machine learning. This significantly limits the number of machine learning systems that can be created and has led to a mismatch between the demand for machine learning systems and the ability for organizations to build them. We believe that in order to meet this growing demand for machine learning systems we must significantly increase the number of individuals that can teach machines. We postulate that we can achieve this goal by making the process of teaching machines easy, fast and above all, universally accessible. While machine learning focuses on creating new algorithms and improving the accuracy of "learners", the machine teaching discipline focuses on the efficacy of the "teachers". Machine teaching as a discipline is a paradigm shift that follows and extends principles of software engineering and programming languages. We put a strong emphasis on the teacher and the teacher's interaction with data, as well as crucial components such as techniques and design principles of interaction and visualization. In this paper, we present our position regarding the discipline of machine teaching and articulate fundamental machine teaching principles. We also describe how, by decoupling knowledge about machine learning algorithms from the process of teaching, we can accelerate innovation and empower millions of new uses for machine learning models.
Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Jul 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 8; 2023: 12; 2024: 6; 2025: 4; 2026: 2.
41 papers.
Sort:
By area:
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 123
- 2021Software Engineering for AI-Based Systems: A Surveycited by 69
- 2021Hybrid Intelligencecited by 55
- 2021The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systemscited by 39
- 2023SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Promptingcited by 39
- 2021DoWhy: Addressing Challenges in Expressing and Validating Causal Assumptionscited by 20
- 2024GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agencycited by 18
- 2023Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Designcited by 15
- 2023Next Steps for Human-Centered Generative AI: A Technical Perspectivecited by 13
- 2021Facilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Modelscited by 12
- 2021Towards Visual Explainable Active Learning for Zero-Shot Classificationcited by 10
- 2022Toward Self-learning End-to-End Task-Oriented Dialog Systemscited by 9
29 more
- 2023Active Self-Supervised Learning: A Few Low-Cost Relationships Are All You Needcited by 9
- 2024Clarify: Improving Model Robustness With Natural Language Correctionscited by 8
- 2024Effective Generative AI: The Human-Algorithm Centaurcited by 8
- 2022Perspectives on Incorporating Expert Feedback into Model Updatescited by 7
- 2022Blind Users Accessing Their Training Images in Teachable Object Recognizerscited by 6
- 2021Exploring Machine Teaching with Childrencited by 4
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agentscited by 4
- 2023Teaching MLOps in Higher Education through Project-Based Learningcited by 3
- 2023ML-Based Teaching Systems: A Conceptual Frameworkcited by 3
- 2022Outcome-Guided Counterfactuals for Reinforcement Learning Agents from a Jointly Trained Generative Latent Spacecited by 2
- 2025Review of Hallucination Understanding in Large Language and Vision Modelscited by 2
- 2022Many Episode Learning in a Modular Embodied Agent via End-to-End Interactioncited by 1
- 2022A Chit-Chats Enhanced Task-Oriented Dialogue Corpora for Fuse-Motive Conversation Systemscited by 1
- 2022Human-AI Interaction Design in Machine Teachingcited by 1
- 2023Towards Fair and Explainable AI using a Human-Centered AI Approachcited by 1
- 2023Teach Me How to Learn: A Perspective Review towards User-centered Neuro-symbolic Learning for Robotic Surgical Systemscited by 1
- 2024Segmentation, Classification and Interpretation of Breast Cancer Medical Images using Human-in-the-Loop Machine Learningcited by 1
- 2024A look under the hood of the Interactive Deep Learning Enterprise (No-IDLE)cited by 1
- 2025Low-Barrier Dataset Collection with Real Human Body for Interactive Per-Garment Virtual Try-Oncited by 1
- 2025Data-Prompt Co-Evolution: Growing Test Sets to Refine LLM Behaviorcited by 1
- 2021Model Rectification via Unknown Unknowns Extraction from Deployment Samplescited by 0
- 2021Towards Teachable Conversational Agentscited by 0
- 2022Know Thy Student: Interactive Learning with Gaussian Processescited by 0
- 2023Evaluating how interactive visualizations can assist in finding samples where and how computer vision models make mistakescited by 0
- 2023A Deep Generative Model for Interactive Data Annotation through Direct Manipulation in Latent Spacecited by 0
- 2023A Virtual Reality Tool for Representing, Visualizing and Updating Deep Learning Modelscited by 0
- 2024Manipulating Predictions over Discrete Inputs in Machine Teachingcited by 0
- 2025Human Guided Learning of Transparent Regression Modelscited by 0
- 2026Nurture-First Agent Development: Building Domain-Expert AI Agents Through Conversational Knowledge Crystallizationcited by 0
- 2026Nurture-First Agent Development: Building Domain-Expert AI Agents Through Conversational Knowledge Crystallization11 Mar 2026
- 2026Feedback by Design: Understanding and Overcoming User Feedback Barriers in Conversational Agents1 Feb 2026
- 2025Data-Prompt Co-Evolution: Growing Test Sets to Refine LLM Behavior14 Oct 2025
- 2025Review of Hallucination Understanding in Large Language and Vision Models26 Sep 2025
- 2025Low-Barrier Dataset Collection with Real Human Body for Interactive Per-Garment Virtual Try-On12 Jun 2025
- 2025Human Guided Learning of Transparent Regression Models21 Feb 2025
- 2024A look under the hood of the Interactive Deep Learning Enterprise (No-IDLE)27 Jun 2024
- 2024Effective Generative AI: The Human-Algorithm Centaur16 Jun 2024
- 2024Segmentation, Classification and Interpretation of Breast Cancer Medical Images using Human-in-the-Loop Machine Learning29 Mar 2024
- 2024GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency13 Feb 2024
- 2024Clarify: Improving Model Robustness With Natural Language Corrections6 Feb 2024
- 2024Manipulating Predictions over Discrete Inputs in Machine Teaching31 Jan 2024
29 more
- 2023Teach Me How to Learn: A Perspective Review towards User-centered Neuro-symbolic Learning for Robotic Surgical Systems7 Jul 2023
- 2023Next Steps for Human-Centered Generative AI: A Technical Perspective27 Jun 2023
- 2023Towards Fair and Explainable AI using a Human-Centered AI Approach12 Jun 2023
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap2 Jun 2023
- 2023A Virtual Reality Tool for Representing, Visualizing and Updating Deep Learning Models24 May 2023
- 2023A Deep Generative Model for Interactive Data Annotation through Direct Manipulation in Latent Space24 May 2023
- 2023Evaluating how interactive visualizations can assist in finding samples where and how computer vision models make mistakes19 May 2023
- 2023SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting15 May 2023
- 2023ML-Based Teaching Systems: A Conceptual Framework12 May 2023
- 2023Active Self-Supervised Learning: A Few Low-Cost Relationships Are All You Need27 Mar 2023
- 2023Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Design6 Mar 2023
- 2023Teaching MLOps in Higher Education through Project-Based Learning2 Feb 2023
- 2022Blind Users Accessing Their Training Images in Teachable Object Recognizers16 Aug 2022
- 2022Outcome-Guided Counterfactuals for Reinforcement Learning Agents from a Jointly Trained Generative Latent Space15 Jul 2022
- 2022Human-AI Interaction Design in Machine Teaching10 Jun 2022
- 2022Perspectives on Incorporating Expert Feedback into Model Updates13 May 2022
- 2022A Chit-Chats Enhanced Task-Oriented Dialogue Corpora for Fuse-Motive Conversation Systems12 May 2022
- 2022Know Thy Student: Interactive Learning with Gaussian Processes26 Apr 2022
- 2022Many Episode Learning in a Modular Embodied Agent via End-to-End Interaction19 Apr 2022
- 2022Toward Self-learning End-to-End Task-Oriented Dialog Systems18 Jan 2022
- 2021Exploring Machine Teaching with Children23 Sep 2021
- 2021DoWhy: Addressing Challenges in Expressing and Validating Causal Assumptions27 Aug 2021
- 2021Towards Visual Explainable Active Learning for Zero-Shot Classification15 Aug 2021
- 2021The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systems7 May 2021
- 2021Software Engineering for AI-Based Systems: A Survey5 May 2021
- 2021Hybrid Intelligence3 May 2021
- 2021Towards Teachable Conversational Agents20 Feb 2021
- 2021Model Rectification via Unknown Unknowns Extraction from Deployment Samples8 Feb 2021
- 2021Facilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Models29 Jan 2021
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 123
- 2021Software Engineering for AI-Based Systems: A Surveycited by 69
- 2021Hybrid Intelligencecited by 55
- 2021The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systemscited by 39
- 2023SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Promptingcited by 39
- 2021DoWhy: Addressing Challenges in Expressing and Validating Causal Assumptionscited by 20
- 2024GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agencycited by 18
- 2023Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Designcited by 15
- 2023Next Steps for Human-Centered Generative AI: A Technical Perspectivecited by 13
- 2021Facilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Modelscited by 12
- 2021Towards Visual Explainable Active Learning for Zero-Shot Classificationcited by 10
- 2022Toward Self-learning End-to-End Task-Oriented Dialog Systemscited by 9
12 most cited of 39 All 39 (JSON)
- 2025Data-Prompt Co-Evolution: Growing Test Sets to Refine LLM Behavior14 Oct 2025
- 2025Review of Hallucination Understanding in Large Language and Vision Models26 Sep 2025
- 2025Low-Barrier Dataset Collection with Real Human Body for Interactive Per-Garment Virtual Try-On12 Jun 2025
- 2025Human Guided Learning of Transparent Regression Models21 Feb 2025
- 2024A look under the hood of the Interactive Deep Learning Enterprise (No-IDLE)27 Jun 2024
- 2024Effective Generative AI: The Human-Algorithm Centaur16 Jun 2024
- 2024Segmentation, Classification and Interpretation of Breast Cancer Medical Images using Human-in-the-Loop Machine Learning29 Mar 2024
- 2024GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency13 Feb 2024
- 2024Clarify: Improving Model Robustness With Natural Language Corrections6 Feb 2024
- 2024Manipulating Predictions over Discrete Inputs in Machine Teaching31 Jan 2024
- 2023Teach Me How to Learn: A Perspective Review towards User-centered Neuro-symbolic Learning for Robotic Surgical Systems7 Jul 2023
- 2023Next Steps for Human-Centered Generative AI: A Technical Perspective27 Jun 2023
12 newest of 39 All 39 (JSON)