Designing for human-AI complementarity in K-12 education
Not on the map. Why?
Abstract (arXiv)
Recent work has explored how complementary strengths of humans and artificial intelligence (AI) systems might be productively combined. However, successful forms of human-AI partnership have rarely been demonstrated in real-world settings. We present the iterative design and evaluation of Lumilo, smart glasses that help teachers help their students in AI-supported classrooms by presenting real-time analytics about students' learning, metacognition, and behavior. Results from a field study conducted in K-12 classrooms indicate that students learn more when teachers and AI tutors work together during class. We discuss implications of this research for the design of human-AI partnerships. We argue for more participatory approaches to research and design in this area, in which practitioners and other stakeholders are deeply, meaningfully involved throughout the process. Furthermore, we advocate for theory-building and for principled approaches to the study of human-AI decision-making in real-world contexts.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 7 of its 39 references that are in the map. First posted on arXiv 2 Apr 2021.
Builds on
7 of 39 references.
References · 7
- 2018Manipulating and Measuring Model Interpretabilitycited by 256
- 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 138
- 2020Learning to Complement Humanscited by 123
- 2020A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scorescited by 74
- 2019Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processescited by 53
- 2019Ask Not What AI Can Do, But What AI Should Do: Towards a Framework of Task Delegabilitycited by 36
- 2020The TA Framework: Designing Real-time Teaching Augmentation for K-12 Classroomscited by 4
Built on by
Citing papers per year: 2022: 7; 2023: 3; 2024: 3; 2025: 3; 2026: 3.
19 papers.
Sort:
By area:
- 2024Determinants of LLM-assisted Decision-Makingcited by 55
- 2024Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMscited by 38
- 2022Improving Human-AI Partnerships in Child Welfare: Understanding Worker Practices, Challenges, and Desires for Algorithmic Decision Supportcited by 37
- 2022Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkitscited by 33
- 2024Evaluating Human-AI Collaboration: A Review and Methodological Frameworkcited by 25
- 2022A Taxonomy of Human and ML Strengths in Decision-Making to Investigate Human-ML Complementaritycited by 22
- 2022Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational Needscited by 19
- 2022Toward Supporting Perceptual Complementarity in Human-AI Collaboration via Reflection on Unobservablescited by 19
- 2022A Test for Evaluating Performance in Human-Computer Systemscited by 8
- 2023Capturing Humans' Mental Models of AI: An Item Response Theory Approachcited by 8
- 2023Training Towards Critical Use: Learning to Situate AI Predictions Relative to Human Knowledgecited by 6
- 2022Algorithmic Decision-Making Safeguarded by Human Knowledgecited by 4
7 more
- 2025Towards responsible AI for education: Hybrid human-AI to confront the Elephant in the roomcited by 3
- 2025Evaluating Trust in AI, Human, and Co-produced Feedback Among Undergraduate Studentscited by 1
- 2026Align When They Want, Complement When They Need! Human-Centered Ensembles for Adaptive Human-AI Collaborationcited by 1
- 2023Recentering Validity Considerations through Early-Stage Deliberations Around AI and Policy Designcited by 0
- 2025From Model to Classroom: Evaluating Generated MCQs for Portuguese with Narrative and Difficulty Concernscited by 0
- 2026The New Social Image: How AI Competency and AI Proactivity Influence Self- and Peer-Perceptions in the Workplacecited by 0
- 2026ConnectED: A Curriculum-Aligned AI System for Vietnamese Instructional Lesson Planning and Student Learningcited by 0
- 2026ConnectED: A Curriculum-Aligned AI System for Vietnamese Instructional Lesson Planning and Student Learning2 Jun 2026
- 2026The New Social Image: How AI Competency and AI Proactivity Influence Self- and Peer-Perceptions in the Workplace29 May 2026
- 2026Align When They Want, Complement When They Need! Human-Centered Ensembles for Adaptive Human-AI Collaboration23 Feb 2026
- 2025From Model to Classroom: Evaluating Generated MCQs for Portuguese with Narrative and Difficulty Concerns18 Jun 2025
- 2025Towards responsible AI for education: Hybrid human-AI to confront the Elephant in the room22 Apr 2025
- 2025Evaluating Trust in AI, Human, and Co-produced Feedback Among Undergraduate Students15 Apr 2025
- 2024Evaluating Human-AI Collaboration: A Review and Methodological Framework9 Jul 2024
- 2024Determinants of LLM-assisted Decision-Making27 Feb 2024
- 2024Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMs12 Jan 2024
- 2023Training Towards Critical Use: Learning to Situate AI Predictions Relative to Human Knowledge30 Aug 2023
- 2023Capturing Humans' Mental Models of AI: An Item Response Theory Approach15 May 2023
- 2023Recentering Validity Considerations through Early-Stage Deliberations Around AI and Policy Design26 Mar 2023
7 more
- 2022Algorithmic Decision-Making Safeguarded by Human Knowledge20 Nov 2022
- 2022Toward Supporting Perceptual Complementarity in Human-AI Collaboration via Reflection on Unobservables28 Jul 2022
- 2022A Test for Evaluating Performance in Human-Computer Systems24 Jun 2022
- 2022Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits13 May 2022
- 2022Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational Needs30 Apr 2022
- 2022A Taxonomy of Human and ML Strengths in Decision-Making to Investigate Human-ML Complementarity22 Apr 2022
- 2022Improving Human-AI Partnerships in Child Welfare: Understanding Worker Practices, Challenges, and Desires for Algorithmic Decision Support5 Apr 2022
- 2024Determinants of LLM-assisted Decision-Makingcited by 55
- 2024Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMscited by 38
- 2022Improving Human-AI Partnerships in Child Welfare: Understanding Worker Practices, Challenges, and Desires for Algorithmic Decision Supportcited by 37
- 2022Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkitscited by 33
- 2024Evaluating Human-AI Collaboration: A Review and Methodological Frameworkcited by 25
- 2022A Taxonomy of Human and ML Strengths in Decision-Making to Investigate Human-ML Complementaritycited by 22
- 2022Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational Needscited by 19
- 2022Toward Supporting Perceptual Complementarity in Human-AI Collaboration via Reflection on Unobservablescited by 19
- 2022A Test for Evaluating Performance in Human-Computer Systemscited by 8
- 2023Capturing Humans' Mental Models of AI: An Item Response Theory Approachcited by 8
- 2023Training Towards Critical Use: Learning to Situate AI Predictions Relative to Human Knowledgecited by 6
- 2022Algorithmic Decision-Making Safeguarded by Human Knowledgecited by 4
12 most cited of 17 All 17 (JSON)
- 2026The New Social Image: How AI Competency and AI Proactivity Influence Self- and Peer-Perceptions in the Workplace29 May 2026
- 2026Align When They Want, Complement When They Need! Human-Centered Ensembles for Adaptive Human-AI Collaboration23 Feb 2026
- 2025From Model to Classroom: Evaluating Generated MCQs for Portuguese with Narrative and Difficulty Concerns18 Jun 2025
- 2025Towards responsible AI for education: Hybrid human-AI to confront the Elephant in the room22 Apr 2025
- 2024Evaluating Human-AI Collaboration: A Review and Methodological Framework9 Jul 2024
- 2024Determinants of LLM-assisted Decision-Making27 Feb 2024
- 2024Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMs12 Jan 2024
- 2023Training Towards Critical Use: Learning to Situate AI Predictions Relative to Human Knowledge30 Aug 2023
- 2023Capturing Humans' Mental Models of AI: An Item Response Theory Approach15 May 2023
- 2023Recentering Validity Considerations through Early-Stage Deliberations Around AI and Policy Design26 Mar 2023
- 2022Algorithmic Decision-Making Safeguarded by Human Knowledge20 Nov 2022
- 2022Toward Supporting Perceptual Complementarity in Human-AI Collaboration via Reflection on Unobservables28 Jul 2022
12 newest of 17 All 17 (JSON)