MiRAGE: Misconception Detection with Retrieval-Guided Multi-Stage Reasoning and Ensemble Fusion
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Detecting student misconceptions in open-ended responses is a longstanding challenge, demanding semantic precision and logical reasoning. We propose MiRAGE - Misconception Detection with Retrieval-Guided Multi-Stage Reasoning and Ensemble Fusion, a novel framework for automated misconception detection in mathematics. MiRAGE operates in three stages: (1) a Retrieval module narrows a large candidate pool to a semantically relevant subset; (2) a Reasoning module employs chain-of-thought generation to expose logical inconsistencies in student solutions; and (3) a Reranking module refines predictions by aligning them with the reasoning. These components are unified through an ensemble-fusion strategy that enhances robustness and interpretability. On mathematics datasets, MiRAGE achieves Mean Average Precision scores of 0.82/0.92/0.93 at levels 1/3/5, consistently outperforming individual modules. By coupling retrieval guidance with multi-stage reasoning, MiRAGE reduces dependence on large-scale language models while delivering a scalable and effective solution for educational assessment.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 24 references that are in the map. First posted on arXiv 3 Nov 2025.
Builds on
21 of 24 references.
References · 21
- 2023GPT-4 Technical Reportcited by 18,132
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2025Qwen3 Technical Reportcited by 8,195
- 2020Supervised Contrastive Learningcited by 2,803
- 2023A Survey of Large Language Modelscited by 2,537
- 2025Gemma 3 Technical Reportcited by 1,686
- 2021Ensemble deep learning: A reviewcited by 283
- 2024Chain-of-Thought Reasoning Without Promptingcited by 208
- 2024The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Modelscited by 89
- 2024LLM-Ensemble: Optimal Large Language Model Ensemble Method for E-commerce Product Attribute Value Extractioncited by 39
9 more
- 2023A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Trainingcited by 16
- 2023Assessing Student Errors in Experimentation Using Artificial Intelligence and Large Language Models: A Comparative Study with Human Raterscited by 16
- 2025Large Language Models For Text Classification: Case Study And Comprehensive Reviewcited by 12
- 2025RLAE: Reinforcement Learning-Assisted Ensemble for LLMscited by 6
- 2017Data-Mining Textual Responses to Uncover Misconception Patternscited by 5
- 2024Improving Academic Skills Assessment with NLP and Ensemble Learningcited by 5
- 2023Accurate Knowledge Distillation with n-best Rerankingcited by 4
- 2023A Review of Hybrid and Ensemble in Deep Learning for Natural Language Processingcited by 3
- 2025Gumbel Reranking: Differentiable End-to-End Reranker Optimizationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026The Correct Answer Trap: Pedagogically-Grounded Detection and Feedback for Hidden Misconceptions
- 2026MisEdu-RAG: A Misconception-Aware Dual-Hypergraph RAG for Novice Math Teachers
- 2026MalruleLib: Large-Scale Executable Misconception Reasoning with Step Traces for Modeling Student Thinking in Mathematics
- 2023Novice Learner and Expert Tutor: Evaluating Math Reasoning Abilities of Large Language Models with Misconceptions
- 2026Catching The Correct Answer Trap: Characterising AI Tutor Blind Spots When Analysing Student Reasoning
- 2026Can LLMs Model Incorrect Student Reasoning? A Case Study on Distractor Generation
- 2024Ask-Before-Detection: Identifying and Mitigating Conformity Bias in LLM-Powered Error Detector for Math Word Problem Solutions
- 2025MathRobust-LV: Evaluation of Large Language Models' Robustness to Linguistic Variations in Mathematical Reasoning