Multi-Task Learning based Online Dialogic Instruction Detection with Pre-trained Language Models
Not on the map. Why?
Abstract (arXiv)
In this work, we study computational approaches to detect online dialogic instructions, which are widely used to help students understand learning materials, and build effective study habits. This task is rather challenging due to the widely-varying quality and pedagogical styles of dialogic instructions. To address these challenges, we utilize pre-trained language models, and propose a multi-task paradigm which enhances the ability to distinguish instances of different classes by enlarging the margin between categories via contrastive loss. Furthermore, we design a strategy to fully exploit the misclassified examples during the training stage. Extensive experiments on a real-world online educational data set demonstrate that our approach achieves superior performance compared to representative baselines. To encourage reproducible results, we make our implementation online available at urlhttps://github.com/AIED2021/multitask-dialogic-instruction.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 29 references that are in the map. First posted on arXiv 15 Jul 2021.
Builds on
12 of 29 references.
References · 12
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
- 2019NEZHA: Neural Contextualized Representation for Chinese Language Understandingcited by 39
- 2018Deep-FSMN for Large Vocabulary Continuous Speech Recognitioncited by 28
- 2020Neural Multi-Task Learning for Teacher Question Detection in Online Classroomscited by 6
- 2019Multimodal Learning For Classroom Activity Detectioncited by 4
- 2020Automatic Dialogic Instruction Detection for K-12 Online One-on-one Classescited by 4
- 2020Representation Learning from Limited Educational Data with Crowdsourced Labelscited by 4
- 2019A Multimodal Alerting System for Online Class Quality Assurancecited by 2
Built on by
Citing papers per year: 2022: 1.
1 paper.