EduResearchBench: A Hierarchical Atomic Task Decomposition Benchmark for Full-Lifecycle Educational Research
Not on the map. Why?
Abstract (arXiv)
While Large Language Models (LLMs) are reshaping the paradigm of AI for Social Science (AI4SS), rigorously evaluating their capabilities in scholarly writing remains a major challenge. Existing benchmarks largely emphasize single-shot, monolithic generation and thus lack the fine-grained assessments required to reflect complex academic research workflows. To fill this gap, we introduce EduResearchBench, the first comprehensive evaluation platform dedicated to educational academic writing. EduResearchBench is built upon our Hierarchical Atomic Task Decomposition (HATD) framework, which decomposes an end-to-end research workflow into six specialized research modules (e.g., Quantitative Analysis, Qualitative Research, and Policy Research) spanning 24 fine-grained atomic tasks. This taxonomy enables an automated evaluation pipeline that mitigates a key limitation of holistic scoring, where aggregate scores often obscure specific capability bottlenecks, and instead provides fine-grained, diagnostic feedback on concrete deficiencies. Moreover, recognizing the high cognitive load inherent in scholarly writing, we propose a curriculum learning strategy that progressively builds competence from foundational skills to complex methodological reasoning and argumentation. Leveraging 55K raw academic samples, we curate 11K high-quality instruction pairs to train EduWrite, a specialized educational scholarly writing model. Experiments show that EduWrite (30B) substantially outperforms larger general-purpose models (72B) on multiple core metrics, demonstrating that in vertical domains, data quality density and hierarchically staged training curricula are more decisive than parameter scale.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 32 references that are in the map. First posted on arXiv 22 Jan 2026.
Builds on
27 of 32 references.
References · 27
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025Qwen3 Technical Reportcited by 8,195
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 738
- 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
15 more
- 2025Seed1.5-VL Technical Reportcited by 367
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 328
- 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 246
- 2023Evaluating the Performance of Large Language Models on GAOKAO Benchmarkcited by 182
- 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 142
- 2024Make Your LLM Fully Utilize the Contextcited by 118
- 2023SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Researchcited by 112
- 2023LawBench: Benchmarking Legal Knowledge of Large Language Modelscited by 111
- 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 95
- 2025A Survey on Trustworthy LLM Agents: Threats and Countermeasurescited by 93
- 2023CMATH: Can Your Language Model Pass Chinese Elementary School Math Test?cited by 89
- 2025AI-Researcher: Autonomous Scientific Innovationcited by 88
- 2024AI for social science and social science of AI: A Surveycited by 29
- 2025EduBench: A Comprehensive Benchmarking Dataset for Evaluating Large Language Models in Diverse Educational Scenarioscited by 16
- 2024E-EVAL: A Comprehensive Chinese K-12 Education Evaluation Benchmark for Large Language Modelscited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ScholarBench: A Bilingual Benchmark for Abstraction, Comprehension, and Reasoning Evaluation in Academic Contexts
- 2024ResearchArena: Benchmarking Large Language Models' Ability to Collect and Organize Information as Research Agents
- 2025HiSciBench: A Hierarchical Multi-disciplinary Benchmark for Scientific Intelligence from Reading to Discovery
- 2026Xpertbench: Expert Level Tasks with Rubrics-Based Evaluation
- 2025EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models
- 2026ScholarSum: Student-Teacher Abstractive Summarization via Knowledge Graph Reasoning and Reflective Refinement
- 2025SCALAR: Scientific Citation-based Live Assessment of Long-context Academic Reasoning
- 2025ELAIPBench: A Benchmark for Expert-Level Artificial Intelligence Paper Understanding