Transparent AI for Mathematics: Transformer-Based Large Language Models for Mathematical Entity Relationship Extraction with XAI
Not on the map. Why?
Abstract (arXiv)
Mathematical text understanding is a challenging task due to the presence of specialized entities and complex relationships between them. This study formulates mathematical problem interpretation as a Mathematical Entity Relation Extraction (MERE) task, where operands are treated as entities and operators as their relationships. Transformer-based models are applied to automatically extract these relations from mathematical text, with Bidirectional Encoder Representations from Transformers (BERT) achieving the best performance, reaching an accuracy of 99.39%. To enhance transparency and trust in the model's predictions, Explainable Artificial Intelligence (XAI) is incorporated using Shapley Additive Explanations (SHAP). The explainability analysis reveals how specific textual and mathematical features influence relation prediction, providing insights into feature importance and model behavior. By combining transformer-based learning, a task-specific dataset, and explainable modeling, this work offers an effective and interpretable framework for MERE, supporting future applications in automated problem solving, knowledge graph construction, and intelligent educational systems.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 38 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
12 of 38 references.
References · 12
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
- 2019Exploiting BERT for End-to-End Aspect-based Sentiment Analysiscited by 57
- 2022Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extractioncited by 44
- 2021MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solvingcited by 32
- 2021Experimental Evaluation of Deep Learning models for Marathi Text Classificationcited by 19
- 2020Mathematical Word Problem Generation from Commonsense Knowledge Graph and Equationscited by 16
- 2020SHAP values for Explaining CNN-based Text Classification Modelscited by 12
- 2020Pretraining and Fine-Tuning Strategies for Sentiment Analysis of Latvian Tweetscited by 4
- 2021Cross-Lingual Text Classification of Transliterated Hindi and Malayalamcited by 4
- 2021Towards Explaining STEM Document Classification using Mathematical Entity Linkingcited by 2
- 2024Feature importance to explain multimodal prediction models. A clinical use casecited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.