Exploring Iterative Enhancement for Improving Learnersourced Multiple-Choice Question Explanations with Large Language Models
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large language models exhibit superior capabilities in processing and understanding language, yet their applications in educational contexts remain underexplored. Learnersourcing enhances learning by engaging students in creating their own educational content. When learnersourcing multiple-choice questions, creating explanations for the solution of a question is a crucial step; it helps other students understand the solution and promotes a deeper understanding of related concepts. However, it is often difficult for students to craft effective solution explanations, due to limited subject understanding. To help scaffold the task of automated explanation generation, we present and evaluate a framework called "ILearner-LLM", that iteratively enhances the generated explanations for the given questions with large language models. Comprising an explanation generation model and an explanation evaluation model, the framework generates high-quality student-aligned explanations by iteratively feeding the quality rating score from the evaluation model back into the instruction prompt of the explanation generation model. Experimental results demonstrate the effectiveness of our ILearner-LLM on LLaMA2-13B and GPT-4 to generate higher quality explanations that are closer to those written by students on five PeerWise datasets. Our findings represent a promising path to enrich the learnersourcing experience for students and to enhance the capabilities of large language models for educational applications.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 18 of its 40 references that are in the map. First posted on arXiv 19 Sep 2023.
Builds on
18 of 40 references.
Closest ancestors · 1
Same direction, newest first
Other references · 17
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2023Reasoning with Language Model is Planning with World Modelcited by 861
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 737
- 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 699
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
- 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 346
5 more
- 2023Iterative Translation Refinement with Large Language Modelscited by 27
- 2017Automatic Generation of Natural Language Explanationscited by 22
- 2019RiPPLE: A Crowdsourced Adaptive Platform for Recommendation of Learning Activitiescited by 11
- 2023Learnersourcing in the Age of AI: Student, Educator and Machine Partnerships for Content Creationcited by 6
- 2021DeepQR: Neural-based Quality Ratings for Learnersourced Multiple-Choice Questionscited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1; 2026: 1.
3 papers.
- 2023User Modeling in the Era of Large Language Models: Current Research and Future Directionscited by 18
- 2026RLearner-LLM: Balancing Logical Grounding and Fluency in Large Language Models via Hybrid Direct Preference Optimizationcited by 2
- 2025MAGMA-Edu: Multi-Agent Generative Multimodal Framework for Text-Diagram Educational Question Generationcited by 0
- 2026RLearner-LLM: Balancing Logical Grounding and Fluency in Large Language Models via Hybrid Direct Preference Optimization6 May 2026
- 2025MAGMA-Edu: Multi-Agent Generative Multimodal Framework for Text-Diagram Educational Question Generation24 Nov 2025
- 2023User Modeling in the Era of Large Language Models: Current Research and Future Directions11 Dec 2023
Similar, not cited
Close in wording, no citation either way
- 2025Socratic Students: Teaching Language Models to Learn by Asking Questions
- 2024Leveraging Large Language Models to Generate Course-specific Semantically Annotated Learning Objects
- 2022Explanations from Large Language Models Make Small Reasoners Better
- 2024The Future of Learning in the Age of Generative AI: Automated Question Generation and Assessment with Large Language Models
- 2024AutoTutor meets Large Language Models: A Language Model Tutor with Rich Pedagogy and Guardrails
- 2025Explain-Query-Test: Self-Evaluating LLMs Via Explanation and Comprehension Discrepancy
- 2024Improving Socratic Question Generation using Data Augmentation and Preference Optimization
- 2022Automatic Generation of Socratic Subquestions for Teaching Math Word Problems