mlsanityData to 7 Oct 2026

ELBench: A Multi-Dimensional Benchmark for Education-Facing Large Language Models

arXiv 2608.09548 ↗First posted 10 Aug 2026cs.CL cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models are increasingly deployed in education as tutors, teaching assistants, and content generators. These roles place demands that ordinary question answering does not: a usable education-facing model is supposed to be accurate, safe under sensitive prompts, instructionally useful, and aligned with pedagogical goals at the same time. Existing benchmarks evaluate these requirements largely in isolation, so none assesses education-facing suitability as an integrated profile. We introduce ELBench, the first benchmark to evaluate all four requirements (General Capability, Safety and Trustworthiness, Basic Education, and High-Level Cultivation) on the same models under a common protocol, combining curated public sources with newly synthesized safety and cultivation data. We evaluate nine models, seven frontier general-purpose systems and two education-specialized variants, and report three findings. First, module-level profiles are more informative than a single aggregate: the top six models are statistically indistinguishable on overall score, yet their module leaders differ substantially, and safety is anti-correlated with practical teaching (r = -0.83). Second, the Chinese-developed models lead the safety module, the most discriminative in the suite; this advantage is largest on region-specific normative content and narrows, but does not vanish, on universal-harm content. Third, the two education-specialized models lead neither education module, and on High-Level Cultivation all models share a systematic blind spot: on the structured judgment task they converge on the same non-reference option, favoring pedagogical style over fit to the stated goal, so the module scores uniformly low and does not separate models. This raises, but does not resolve, whether domain post-training keeps pace with frontier systems on education tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 50 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

28 of 50 references.

References · 28

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  3. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  4. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  5. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  6. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  7. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
  8. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  9. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  10. 2022Red Teaming Language Models with Language Modelscited by 983
  11. 2021Ethical and social risks of harm from Language Modelscited by 957
  12. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
16 more
  1. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
  2. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
  3. 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 505
  4. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
  5. 2024Large Language Models for Education: A Survey and Outlookcited by 185
  6. 2023MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problemscited by 128
  7. 2024Unifying AI Tutor Evaluation: An Evaluation Taxonomy for Pedagogical Ability Assessment of LLM-Powered AI Tutorscited by 60
  8. 2025Training LLM-based Tutors to Improve Student Learning Outcomes in Dialoguescited by 40
  9. 2026MiniMax Sparse Attentioncited by 34
  10. 2024TeachTune: Reviewing Pedagogical Agents Against Diverse Student Profiles with Simulated Studentscited by 25
  11. 2025EducationQ: Evaluating LLMs' Teaching Capabilities Through Multi-Agent Dialogue Frameworkcited by 23
  12. 2025EduBench: A Comprehensive Benchmarking Dataset for Evaluating Large Language Models in Diverse Educational Scenarioscited by 16
  13. 2025EduGuardBench: A Holistic Benchmark for Evaluating the Pedagogical Fidelity and Adversarial Safety of LLMs as Simulated Teacherscited by 5
  14. 2025ELMES: An Automated Framework for Evaluating Large Language Models in Educational Scenarioscited by 4
  15. 2026SHAPE: Unifying Safety, Helpfulness and Pedagogy for Educational LLMscited by 3
  16. 2025OmniEduBench: A Comprehensive Chinese Benchmark for Evaluating Large Language Models in Educationcited by 1

Built on by

Not cited yet.