mlsanityData to 7 Oct 2026

MiRAGE: Misconception Detection with Retrieval-Guided Multi-Stage Reasoning and Ensemble Fusion

arXiv 2511.01182 ↗First posted 3 Nov 2025cs.AIcited by 1

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Detecting student misconceptions in open-ended responses is a longstanding challenge, demanding semantic precision and logical reasoning. We propose MiRAGE - Misconception Detection with Retrieval-Guided Multi-Stage Reasoning and Ensemble Fusion, a novel framework for automated misconception detection in mathematics. MiRAGE operates in three stages: (1) a Retrieval module narrows a large candidate pool to a semantically relevant subset; (2) a Reasoning module employs chain-of-thought generation to expose logical inconsistencies in student solutions; and (3) a Reranking module refines predictions by aligning them with the reasoning. These components are unified through an ensemble-fusion strategy that enhances robustness and interpretability. On mathematics datasets, MiRAGE achieves Mean Average Precision scores of 0.82/0.92/0.93 at levels 1/3/5, consistently outperforming individual modules. By coupling retrieval guidance with multi-stage reasoning, MiRAGE reduces dependence on large-scale language models while delivering a scalable and effective solution for educational assessment.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 24 references that are in the map. First posted on arXiv 3 Nov 2025.

Builds on

21 of 24 references.

References · 21

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2020Supervised Contrastive Learningcited by 2,803
  7. 2023A Survey of Large Language Modelscited by 2,537
  8. 2025Gemma 3 Technical Reportcited by 1,686
  9. 2021Ensemble deep learning: A reviewcited by 283
  10. 2024Chain-of-Thought Reasoning Without Promptingcited by 208
  11. 2024The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Modelscited by 89
  12. 2024LLM-Ensemble: Optimal Large Language Model Ensemble Method for E-commerce Product Attribute Value Extractioncited by 39
9 more
  1. 2023A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Trainingcited by 16
  2. 2023Assessing Student Errors in Experimentation Using Artificial Intelligence and Large Language Models: A Comparative Study with Human Raterscited by 16
  3. 2025Large Language Models For Text Classification: Case Study And Comprehensive Reviewcited by 12
  4. 2025RLAE: Reinforcement Learning-Assisted Ensemble for LLMscited by 6
  5. 2017Data-Mining Textual Responses to Uncover Misconception Patternscited by 5
  6. 2024Improving Academic Skills Assessment with NLP and Ensemble Learningcited by 5
  7. 2023Accurate Knowledge Distillation with n-best Rerankingcited by 4
  8. 2023A Review of Hybrid and Ensemble in Deep Learning for Natural Language Processingcited by 3
  9. 2025Gumbel Reranking: Differentiable End-to-End Reranker Optimizationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Correct Answer Trap: Pedagogically-Grounded Detection and Feedback for Hidden Misconceptions
  2. 2026MisEdu-RAG: A Misconception-Aware Dual-Hypergraph RAG for Novice Math Teachers
  3. 2026MalruleLib: Large-Scale Executable Misconception Reasoning with Step Traces for Modeling Student Thinking in Mathematics
  4. 2023Novice Learner and Expert Tutor: Evaluating Math Reasoning Abilities of Large Language Models with Misconceptions
  5. 2026Catching The Correct Answer Trap: Characterising AI Tutor Blind Spots When Analysing Student Reasoning
  6. 2026Can LLMs Model Incorrect Student Reasoning? A Case Study on Distractor Generation
  7. 2024Ask-Before-Detection: Identifying and Mitigating Conformity Bias in LLM-Powered Error Detector for Math Word Problem Solutions
  8. 2025MathRobust-LV: Evaluation of Large Language Models' Robustness to Linguistic Variations in Mathematical Reasoning