Towards responsible AI for education: Hybrid human-AI to confront the Elephant in the room
Not on the map. Why?
Abstract (arXiv)
Despite significant advancements in AI-driven educational systems and ongoing calls for responsible AI for education, several critical issues remain unresolved -- acting as the elephant in the room within AI in education, learning analytics, educational data mining, learning sciences, and educational psychology communities. This critical analysis identifies and examines nine persistent challenges that continue to undermine the fairness, transparency, and effectiveness of current AI methods and applications in education. These include: (1) the lack of clarity around what AI for education truly means -- often ignoring the distinct purposes, strengths, and limitations of different AI families -- and the trend of equating it with domain-agnostic, company-driven large language models; (2) the widespread neglect of essential learning processes such as motivation, emotion, and (meta)cognition in AI-driven learner modelling and their contextual nature; (3) limited integration of domain knowledge and lack of stakeholder involvement in AI design and development; (4) continued use of non-sequential machine learning models on temporal educational data; (5) misuse of non-sequential metrics to evaluate sequential models; (6) use of unreliable explainable AI methods to provide explanations for black-box models; (7) ignoring ethical guidelines in addressing data inconsistencies during model training; (8) use of mainstream AI methods for pattern discovery and learning analytics without systematic benchmarking; and (9) overemphasis on global prescriptions while overlooking localised, student-specific recommendations. Supported by theoretical and empirical research, we demonstrate how hybrid AI methods -- specifically neural-symbolic AI -- can address the elephant in the room and serve as the foundation for responsible, trustworthy AI systems in education.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 41 of its 206 references that are in the map. First posted on arXiv 22 Apr 2025.
Builds on
41 of 206 references.
References · 41
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2019An Introduction to Variational Autoencoderscited by 1,000
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 443
- 2017Efficient Processing of Deep Neural Networks: A Tutorial and Surveycited by 434
- 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 372
- 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 344
- 2015Deep Knowledge Tracingcited by 332
- 2019Interpretable machine learning: definitions, methods, and applicationscited by 305
29 more
- 2019Deep Learning for Symbolic Mathematicscited by 270
- 2016Model-Agnostic Interpretability of Machine Learningcited by 219
- 2020Problems with Shapley-value-based explanations as feature importance measurescited by 200
- 2017Neural-Symbolic Learning and Reasoning: A Survey and Interpretationcited by 196
- 2024Teaching Large Language Models to Reason with Reinforcement Learningcited by 160
- 2022The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspectivecited by 159
- 2024Rethinking Interpretability in the Era of Large Language Modelscited by 111
- 2020On the Tractability of SHAP Explanationscited by 92
- 2020Explaining the Explainer: A First Theoretical Analysis of LIMEcited by 89
- 2023Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Reviewcited by 83
- 2022Knowledge Tracing: A Surveycited by 77
- 2021Incorporating Domain Knowledge into Deep Neural Networkscited by 56
- 2018Addressing Two Problems in Deep Knowledge Tracing via Prediction-Consistent Regularizationcited by 55
- 2023Fine-tuning ChatGPT for Automatic Scoringcited by 51
- 2019Measurable Counterfactual Local Explanations for Any Classifiercited by 48
- 2024Preference Learning Algorithms Do Not Learn Preference Rankingscited by 48
- 2018Defining Locality for Surrogates in Post-hoc Interpretablitycited by 33
- 2024Evaluating the Effectiveness of LLMs in Introductory Computer Science Education: A Semester-Long Field Studycited by 26
- 2024Large Language Models are Biased Because They Are Large Language Modelscited by 26
- 2021Designing for human-AI complementarity in K-12 educationcited by 19
- 2018AI in Education needs interpretable machine learning: Lessons from Open Learner Modellingcited by 18
- 2024Promises and challenges of generative artificial intelligence for human learningcited by 17
- 2024The Ethics of AI in Educationcited by 7
- 2025Symbolic Knowledge Extraction and Injection with Sub-symbolic Predictors: A Systematic Literature Reviewcited by 7
- 2024Responsible Artificial Intelligence: A Structured Literature Reviewcited by 6
- 2023Augmenting deep neural networks with symbolic knowledge: Towards trustworthy and interpretable AI for educationcited by 4
- 2025Towards Responsible and Trustworthy Educational Data Mining: Comparing Symbolic, Sub-Symbolic, and Neural-Symbolic AI Methodscited by 3
- 2024A Manifesto for a Pro-Actively Responsible AI in Educationcited by 2
- 2023The Paradigm Shifts in Artificial Intelligencecited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Problems With Large Language Models for Learner Modelling: Why LLMs Alone Fall Short for Responsible Tutoring in K--12 Educationcited by 2
- 2026Neural-Symbolic Knowledge Tracing: Injecting Educational Knowledge into Deep Learning for Responsible Learner Modellingcited by 1
- 2026Aurora: Neuro-Symbolic AI Driven Advising Agentcited by 0
- 2026Neural-Symbolic Knowledge Tracing: Injecting Educational Knowledge into Deep Learning for Responsible Learner Modelling9 Apr 2026
- 2026Aurora: Neuro-Symbolic AI Driven Advising Agent20 Feb 2026
- 2025Problems With Large Language Models for Learner Modelling: Why LLMs Alone Fall Short for Responsible Tutoring in K--12 Education28 Dec 2025