End-to-End Evaluation of a Spoken Dialogue System for Learning Basic Mathematics
Not on the map. Why?
Abstract (arXiv)
The advances in language-based Artificial Intelligence (AI) technologies applied to build educational applications can present AI for social-good opportunities with a broader positive impact. Across many disciplines, enhancing the quality of mathematics education is crucial in building critical thinking and problem-solving skills at younger ages. Conversational AI systems have started maturing to a point where they could play a significant role in helping students learn fundamental math concepts. This work presents a task-oriented Spoken Dialogue System (SDS) built to support play-based learning of basic math concepts for early childhood education. The system has been evaluated via real-world deployments at school while the students are practicing early math concepts with multimodal interactions. We discuss our efforts to improve the SDS pipeline built for math learning, for which we explore utilizing MathBERT representations for potential enhancement to the Natural Language Understanding (NLU) module. We perform an end-to-end evaluation using real-world deployment outputs from the Automatic Speech Recognition (ASR), Intent Recognition, and Dialogue Manager (DM) components to understand how error propagation affects the overall performance in real-world scenarios.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 37 of its 86 references that are in the map. First posted on arXiv 7 Nov 2022.
Builds on
37 of 86 references.
References · 37
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
- 2015Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Modelscited by 207
- 2019Benchmarking Natural Language Understanding Services for building Conversational Agentscited by 166
- 2017A Survey on Dialogue Systems: Recent Advances and New Frontierscited by 162
- 2016Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Fillingcited by 137
- 2016Learning End-to-End Goal-Oriented Dialogcited by 104
- 2019ConveRT: Efficient and Accurate Conversational Representations from Transformerscited by 95
- 2020DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialoguecited by 89
25 more
- 2017Rasa: Open Source Language Understanding and Dialogue Managementcited by 67
- 2021MathBERT: A Pre-Trained Model for Mathematical Formula Understandingcited by 58
- 2021MathBERT: A Pre-trained Language Model for General NLP Tasks in Mathematics Educationcited by 37
- 2016Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Accesscited by 36
- 2020DIET: Lightweight Language Understanding for Dialogue Systemscited by 35
- 2015Evaluating Prerequisite Qualities for Learning End-to-End Dialog Systemscited by 34
- 2015A Survey of Available Corpora for Building Data-Driven Dialogue Systemscited by 33
- 2016Towards End-to-End Learning for Dialog State Tracking and Management using Deep Reinforcement Learningcited by 29
- 2017StarSpace: Embed All The Things!cited by 24
- 2021Phoneme-BERT: Joint Language Modelling of Phoneme Sequence and ASR Transcriptcited by 21
- 2017End-to-End Optimization of Task-Oriented Dialogue Model with Deep Reinforcement Learningcited by 19
- 2017Sample-efficient Actor-Critic Reinforcement Learning with Supervised Data for Dialogue Managementcited by 18
- 2022Data Augmentation with Paraphrase Generation and Entity Extraction for Multimodal Dialogue Systemcited by 16
- 2019Dialogue Transformerscited by 13
- 2019Hierarchical Multi-Task Natural Language Understanding for Cross-domain Conversational AI: HERMIT NLUcited by 13
- 2021N-Best ASR Transformer: Enhancing SLU Performance using Multiple ASR Hypothesescited by 12
- 2019Automatic Generation of Headlines for Online Math Questionscited by 10
- 2019Natural Language Interactions in Autonomous Vehicles: Intent Detection and Slot Filling from Passenger Utterancescited by 8
- 2016SimpleDS: A Simple Deep Reinforcement Learning Dialogue Systemcited by 7
- 2019Modeling Intent, Dialog Policies and Response Adaptation for Goal-Oriented Interactionscited by 5
- 2021Semi-supervised Interactive Intent Labelingcited by 5
- 2018Mathematics Content Understanding for Cyberlearning via Formula Evolution Mapcited by 3
- 2021Improving Controllability of Educational Question Generation by Keyword Provisioncited by 3
- 2020Improving Classification through Weak Supervision in Context-specific Conversational Agent Development for Teacher Educationcited by 2
- 2022NLU for Game-based Learning in Real: Initial Evaluationscited by 2
Built on by
Citing papers per year: 2023: 2.
2 papers.