K-Function: Joint Pronunciation Transcription and Feedback for Evaluating Kids Language Function
Not on the map. Why?
Abstract (arXiv)
Evaluating young children's language is challenging for automatic speech recognizers due to high-pitched voices, prolonged sounds, and limited data. We introduce K-Function, a framework that combines accurate sub-word transcription with objective, Large Language Model (LLM)-driven scoring. Its core, Kids-Weighted Finite State Transducer (K-WFST), merges an acoustic phoneme encoder with a phoneme-similarity model to capture child-specific speech errors while remaining fully interpretable. K-WFST achieves a 1.39 % phoneme error rate on MyST and 8.61 % on Multitudes-an absolute improvement of 10.47 % and 7.06 % over a greedy-search decoder. These high-quality transcripts are used by an LLM to grade verbal skills, developmental milestones, reading, and comprehension, with results that align closely with human evaluators. Our findings show that precise phoneme recognition is essential for creating an effective assessment framework, enabling scalable language screening for children.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 51 references that are in the map. First posted on arXiv 3 Jul 2025.
Builds on
28 of 51 references.
References · 28
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
- 2024Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Modelscited by 29
- 2021Phone-to-audio alignment without text: A Semi-supervised Approachcited by 26
- 2023Towards Better Domain Adaptation for Self-supervised Models: A Case Study of Child ASRcited by 23
- 2023Unconstrained Dysfluency Modeling for Dysfluent Speech Transcription and Detectioncited by 21
- 2022A Study on the Integration of Pre-trained SSL, ASR, LM and SLU Models for Spoken Language Understandingcited by 18
- 2024Coding Speech through Vocal Tract Kinematicscited by 18
16 more
- 2024YOLO-Stutter: End-to-end Region-Wise Speech Dysfluency Detectioncited by 16
- 2024Towards Hierarchical Spoken Language Dysfluency Modelingcited by 15
- 2024SSDM: Scalable Speech Dysfluency Modelingcited by 13
- 2022Deep Neural Convolutive Matrix Factorization for Articulatory Representation Decompositioncited by 12
- 2023Deep Speech Synthesis from MRI-Based Articulatory Representationscited by 12
- 2022Articulatory Representation Learning Via Joint Factor Analysis and Neural Matrix Factorizationcited by 11
- 2024Stutter-Solver: End-to-end Multi-lingual Dysfluency Detectioncited by 8
- 2025Analysis and Evaluation of Synthetic Data Generation in Speech Dysfluency Detectioncited by 8
- 2024Analysis of Self-Supervised Speech Models on Children's Speech and Infant Vocalizationscited by 7
- 2020Analysis of Disfluency in Children's Speechcited by 6
- 2025Selective Attention Merging for low resource tasks: A case study of Child ASRcited by 6
- 2023Enhancing Child Vocalization Classification with Phonetically-Tuned Embeddings for Assisting Autism Diagnosiscited by 5
- 2025Dysfluent WFST: A Framework for Zero-Shot Speech Dysfluency Transcription and Detectioncited by 5
- 2024Exploring Speech Foundation Models for Speaker Diarization in Child-Adult Dyadic Interactionscited by 4
- 2025Seamless Dysfluent Speech Text Alignment for Disordered Speech Analysiscited by 4
- 2025Causal Analysis of ASR Errors for Children: Quantifying the Impact of Physiological, Cognitive, and Extrinsic Factorscited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025The Sound of Syntax: Finetuning and Comprehensive Evaluation of Language Models for Speech Pathology
- 2026Multimodal LLMs are not all you need for Pediatric Speech Language Pathology
- 2026FSA-GRPO: Teaching Auditory LLMs to Use Few-Shot Demonstrations
- 2023MUST: A Multilingual Student-Teacher Learning approach for low-resource speech recognition
- 2020LSTM Acoustic Models Learn to Align and Pronounce with Graphemes ↗
- 2026Reasoning Beyond Transcription: Audio Language Models on Child Stuttering Speech
- 2025JCAPT: A Joint Modeling Approach for CAPT
- 2024Pronunciation Assessment with Multi-modal Large Language Models