HuPER: A Human-Inspired Framework for Phonetic Perception
Not on the map. Why?
Abstract (arXiv)
We propose HuPER, a human-inspired framework that models phonetic perception as adaptive inference over acoustic-phonetics evidence and linguistic knowledge. With only 100 hours of training data, HuPER achieves state-of-the-art phonetic error rates on five English benchmarks and strong zero-shot transfer to 95 unseen languages. HuPER is also the first framework to enable adaptive, multi-path phonetic perception under diverse acoustic conditions. All training data, models, and code are open-sourced. Code and demo avaliable at https://github.com/Berkeley-Speech-Group/HuPER.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 29 of its 72 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
29 of 72 references.
References · 29
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
- 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
- 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
- 2023Scaling Speech Technology to 1,000+ Languagescited by 401
- 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 264
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
- 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 228
- 2023Prediction-Powered Inferencecited by 214
17 more
- 2020Universal Phone Recognition with a Multilingual Allophone Systemcited by 81
- 2021Simple and Effective Zero-shot Cross-lingual Phoneme Recognitioncited by 79
- 2024Self-Supervised Speech Representations are More Phonetic than Semanticcited by 70
- 2021speechocean762: An Open-Source Non-native English Speech Corpus For Pronunciation Assessmentcited by 57
- 2022ByT5 model for massively multilingual grapheme-to-phoneme conversioncited by 49
- 2025Omnilingual ASR: Open-Source Multilingual Speech Recognition for 1600+ Languagescited by 32
- 2023BabySLM: language-acquisition-friendly benchmark of self-supervised spoken language modelscited by 29
- 2023WavJourney: Compositional Audio Creation with Large Language Modelscited by 27
- 2025ZIPA: A family of efficient models for multilingual phone recognitioncited by 18
- 2025POWSM: A Phonetic Open Whisper-Style Speech Foundation Modelcited by 14
- 2023Allophant: Cross-lingual Phoneme Recognition with Articulatory Attributescited by 13
- 2024SSDM: Scalable Speech Dysfluency Modelingcited by 13
- 2024Phonetic Segmentation of the UCLA Phonetics Lab Archivecited by 9
- 2025Mixture of Cognitive Reasoners: Modular Reasoning with Brain-Like Specializationcited by 9
- 2023MultiPA: A Multi-task Speech Pronunciation Assessment Model for Open Response Scenarioscited by 7
- 2025Dysfluent WFST: A Framework for Zero-Shot Speech Dysfluency Transcription and Detectioncited by 5
- 2025Speech World Model: Causal State-Action Planning with Explicit Reasoning for Speechcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.