AISHELL-NER: Named Entity Recognition from Chinese Speech
Not on the map. Why?
Abstract (arXiv)
Named Entity Recognition (NER) from speech is among Spoken Language Understanding (SLU) tasks, aiming to extract semantic information from the speech signal. NER from speech is usually made through a two-step pipeline that consists of (1) processing the audio using an Automatic Speech Recognition (ASR) system and (2) applying an NER tagger to the ASR outputs. Recent works have shown the capability of the End-to-End (E2E) approach for NER from English and French speech, which is essentially entity-aware ASR. However, due to the many homophones and polyphones that exist in Chinese, NER from Chinese speech is effectively a more challenging task. In this paper, we introduce a new dataset AISEHLL-NER for NER from Chinese speech. Extensive experiments are conducted to explore the performance of several state-of-the-art methods. The results demonstrate that the performance could be improved by combining entity-aware ASR and pretrained NER tagger, which can be easily applied to the modern SLU pipeline. The dataset is publicly available at github.com/Alibaba-NLP/AISHELL-NER.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 17 Feb 2022.
Builds on
12 of 22 references.
References · 12
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 364
- 2019A Comparative Study on Transformer vs RNN in Speech Applicationscited by 210
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
- 2017An analysis of incorporating an external language model into a sequence-to-sequence modelcited by 109
- 2018Chinese NER Using Lattice LSTMcited by 81
- 2020FLAT: Chinese NER Using Flat-Lattice Transformercited by 67
- 2020End-to-end Named Entity Recognition from English Speechcited by 36
- 2019Audio De-identification: A New Entity Recognition Taskcited by 14
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 6; 2025: 6; 2026: 2.
19 papers.
Sort:
By area:
- 2023CopyNE: Better Contextual ASR by Copying Named Entitiescited by 13
- 2024Using Large Language Model for End-to-End Chinese ASR and NERcited by 6
- 2022Joint Speech Translation and Named Entity Recognitioncited by 5
- 2024DANCER: Entity Description Augmented Named Entity Corrector for Automatic Speech Recognitioncited by 4
- 2024Large Language Model Should Understand Pinyin for Chinese ASR Error Correctioncited by 3
- 2026Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluationcited by 2
- 2024Double Mixture: Towards Continual Event Detection from Speechcited by 1
- 2024Medical Spoken Named Entity Recognitioncited by 1
- 2025Improving Contextual ASR via Multi-grained Fusion with Large Language Modelscited by 1
- 2025Enhancing the Robustness of Contextual ASR to Varying Biasing Information Volumes Through Purified Semantic Correlation Joint Modelingcited by 1
- 2022Mining Word Boundaries in Speech as Naturally Annotated Word Segmentation Datacited by 0
- 2023Leveraging Cross-Lingual Transfer Learning in Spoken Named Entity Recognition Systemscited by 0
7 more
- 2023CPPF: A contextual and post-processing-free model for automatic speech recognitioncited by 0
- 2024Mining Word Boundaries from Speech-Text Parallel Data for Cross-domain Chinese Word Segmentationcited by 0
- 2025Joint Automatic Speech Recognition And Structure Learning For Better Speech Understandingcited by 0
- 2025UniSLU: Unified Spoken Language Understanding from Heterogeneous Cross-Task Datasetscited by 0
- 2025Generative Annotation for ASR Named Entity Correctioncited by 0
- 2025PARCO: Phoneme-Augmented Robust Contextual ASR via Contrastive Entity Disambiguationcited by 0
- 2026JSPG: Dynamic Dictionary Filtering via Joint Semantic-Pinyin-Glyph Retrieval for Chinese Contextual ASRcited by 0
- 2026Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluation28 May 2026
- 2026JSPG: Dynamic Dictionary Filtering via Joint Semantic-Pinyin-Glyph Retrieval for Chinese Contextual ASR16 May 2026
- 2025Enhancing the Robustness of Contextual ASR to Varying Biasing Information Volumes Through Purified Semantic Correlation Joint Modeling7 Sep 2025
- 2025PARCO: Phoneme-Augmented Robust Contextual ASR via Contrastive Entity Disambiguation4 Sep 2025
- 2025Generative Annotation for ASR Named Entity Correction28 Aug 2025
- 2025UniSLU: Unified Spoken Language Understanding from Heterogeneous Cross-Task Datasets17 Jul 2025
- 2025Improving Contextual ASR via Multi-grained Fusion with Large Language Models16 Jul 2025
- 2025Joint Automatic Speech Recognition And Structure Learning For Better Speech Understanding13 Jan 2025
- 2024Mining Word Boundaries from Speech-Text Parallel Data for Cross-domain Chinese Word Segmentation12 Dec 2024
- 2024Large Language Model Should Understand Pinyin for Chinese ASR Error Correction20 Sep 2024
- 2024Medical Spoken Named Entity Recognition19 Jun 2024
- 2024Double Mixture: Towards Continual Event Detection from Speech20 Apr 2024
7 more
- 2024DANCER: Entity Description Augmented Named Entity Corrector for Automatic Speech Recognition26 Mar 2024
- 2024Using Large Language Model for End-to-End Chinese ASR and NER21 Jan 2024
- 2023CPPF: A contextual and post-processing-free model for automatic speech recognition14 Sep 2023
- 2023Leveraging Cross-Lingual Transfer Learning in Spoken Named Entity Recognition Systems3 Jul 2023
- 2023CopyNE: Better Contextual ASR by Copying Named Entities22 May 2023
- 2022Mining Word Boundaries in Speech as Naturally Annotated Word Segmentation Data31 Oct 2022
- 2022Joint Speech Translation and Named Entity Recognition21 Oct 2022
- 2023CopyNE: Better Contextual ASR by Copying Named Entitiescited by 13
- 2024Using Large Language Model for End-to-End Chinese ASR and NERcited by 6
- 2022Joint Speech Translation and Named Entity Recognitioncited by 5
- 2024DANCER: Entity Description Augmented Named Entity Corrector for Automatic Speech Recognitioncited by 4
- 2024Large Language Model Should Understand Pinyin for Chinese ASR Error Correctioncited by 3
- 2024Double Mixture: Towards Continual Event Detection from Speechcited by 1
- 2024Medical Spoken Named Entity Recognitioncited by 1
- 2025Improving Contextual ASR via Multi-grained Fusion with Large Language Modelscited by 1
- 2025Enhancing the Robustness of Contextual ASR to Varying Biasing Information Volumes Through Purified Semantic Correlation Joint Modelingcited by 1
- 2022Mining Word Boundaries in Speech as Naturally Annotated Word Segmentation Datacited by 0
- 2023Leveraging Cross-Lingual Transfer Learning in Spoken Named Entity Recognition Systemscited by 0
- 2023CPPF: A contextual and post-processing-free model for automatic speech recognitioncited by 0
12 most cited of 18 All 18 (JSON)
- 2026JSPG: Dynamic Dictionary Filtering via Joint Semantic-Pinyin-Glyph Retrieval for Chinese Contextual ASR16 May 2026
- 2025Enhancing the Robustness of Contextual ASR to Varying Biasing Information Volumes Through Purified Semantic Correlation Joint Modeling7 Sep 2025
- 2025PARCO: Phoneme-Augmented Robust Contextual ASR via Contrastive Entity Disambiguation4 Sep 2025
- 2025Generative Annotation for ASR Named Entity Correction28 Aug 2025
- 2025UniSLU: Unified Spoken Language Understanding from Heterogeneous Cross-Task Datasets17 Jul 2025
- 2025Improving Contextual ASR via Multi-grained Fusion with Large Language Models16 Jul 2025
- 2025Joint Automatic Speech Recognition And Structure Learning For Better Speech Understanding13 Jan 2025
- 2024Mining Word Boundaries from Speech-Text Parallel Data for Cross-domain Chinese Word Segmentation12 Dec 2024
- 2024Large Language Model Should Understand Pinyin for Chinese ASR Error Correction20 Sep 2024
- 2024Medical Spoken Named Entity Recognition19 Jun 2024
- 2024Double Mixture: Towards Continual Event Detection from Speech20 Apr 2024
- 2024DANCER: Entity Description Augmented Named Entity Corrector for Automatic Speech Recognition26 Mar 2024
12 newest of 18 All 18 (JSON)