SimClass: A Classroom Speech Dataset Generated via Game Engine Simulation For Automatic Speech Recognition Research
Not on the map. Why?
Abstract (arXiv)
The scarcity of large-scale classroom speech data has hindered the development of AI-driven speech models for education. Public classroom datasets remain limited, and the lack of a dedicated classroom noise corpus prevents the use of standard data augmentation techniques. In this paper, we introduce a scalable methodology for synthesizing classroom noise using game engines, a framework that extends to other domains. Using this methodology, we present SimClass, a dataset that includes both a synthesized classroom noise corpus and a simulated classroom speech dataset. The speech data is generated by pairing a public children's speech corpus with YouTube lecture videos to approximate real classroom interactions in clean conditions. Our experiments on clean and noisy speech demonstrate that SimClass closely approximates real classroom speech, making it a valuable resource for developing robust speech recognition and enhancement models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 35 references that are in the map. First posted on arXiv 10 Jun 2025.
Builds on
15 of 35 references.
References · 15
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2015MUSAN: A Music, Speech, and Noise Corpuscited by 425
- 2018SDR - half-baked or well done?cited by 423
- 2018TED-LIUM 3: twice as much data and corpus repartition for experiments on speaker adaptationcited by 226
- 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Trainingcited by 151
- 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberationcited by 105
- 2022The NCTE Transcripts: A Dataset of Elementary Math Classroom Transcriptscited by 43
- 2024Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Modelscited by 29
- 2023My Science Tutor (MyST) -- A Large Corpus of Children's Conversational Speechcited by 28
- 2023Kid-Whisper: Towards Bridging the Performance Gap in Automatic Speech Recognition for Children VS. Adultscited by 27
- 2023Towards Better Domain Adaptation for Self-supervised Models: A Case Study of Child ASRcited by 23
- 2023Adapting Multilingual Speech Representation Model for a New, Underresourced Language through Multilingual Fine-tuning and Continued Pretrainingcited by 18
3 more
- 2024Predicting positive transfer for improved low-resource speech recognition using acoustic pseudo-tokenscited by 11
- 2024CPT-Boosted Wav2vec2.0: Towards Noise Robust Speech Recognition for Classroom Environmentscited by 7
- 2021On Determinism of Game Engines used for Simulation-based Autonomous Vehicle Verificationcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.