Decoding Student Minds: Leveraging Conversational Agents for Psychological and Learning Analysis
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
This paper presents a psychologically-aware conversational agent designed to enhance both learning performance and emotional well-being in educational settings. The system combines Large Language Models (LLMs), a knowledge graph-enhanced BERT (KG-BERT), and a bidirectional Long Short-Term Memory (LSTM) network with attention to classify students' cognitive and affective states in real time. Unlike prior chatbots limited to either tutoring or affective support, our approach leverages multimodal data-including textual semantics, prosodic speech features, and temporal behavioral trends-to infer engagement, stress, and conceptual understanding. A pilot study with 45 university students demonstrated improved motivation, reduced stress, and moderate academic gains compared to unimodal baselines. We explicitly discuss the exploratory nature of this small-sample pilot, report effect sizes and inter-rater reliability alongside significance tests, and provide an ablation analysis isolating the contribution of the knowledge-graph component and of each modality. These results underline the promise-while acknowledging the current limits in scale and modality balance-of integrating semantic reasoning, multimodal fusion, and temporal modeling to support adaptive, student-centered educational interventions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 12 of its 40 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
12 of 40 references.
Closest ancestors · 1
Same direction, newest first
Other references · 11
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
- 2024Multimodal Alignment and Fusion: A Surveycited by 73
- 2024Knowledge Graph Enhanced Language Agents for Recommendationcited by 11
- 2025Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospectscited by 10
- 2022GraphMFT: A Graph Network based Multimodal Fusion Technique for Emotion Recognition in Conversationcited by 8
- 2023How to Build an Adaptive AI Tutor for Any Course Using Knowledge Graph-Enhanced Retrieval-Augmented Generation (KG-RAG)cited by 7
- 2025Large Language Models for Knowledge Graph Embedding: A Surveycited by 3
- 2024A Knowledge-Enhanced Disease Diagnosis Method Based on Prompt Learning and BERT Integrationcited by 1
- 2025MathBuddy: A Multimodal System for Affective Math Tutoringcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Tool to Teammate: LLM Coding Agents as Collaborative Partners for Behavioral Labeling in Educational Dialogue Analysis
- 2025Dialogic Pedagogy for Large Language Models: Aligning Conversational AI with Proven Theories of Learning
- 2024TeachTune: Reviewing Pedagogical Agents Against Diverse Student Profiles with Simulated Students
- 2024AgentPeerTalk: Empowering Students through Agentic-AI-Driven Discernment of Bullying and Joking in Peer Interactions in Schools
- 2023FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions
- 2025OnlineMate: An LLM-Based Multi-Agent Companion System for Cognitive Support in Online Learning
- 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspective
- 2024Ruffle&Riley: Insights from Designing and Evaluating a Large Language Model-Based Conversational Tutoring System