Misspelling Oblivious Word Embeddings
Not on the map. Why?
Abstract (arXiv)
In this paper we present a method to learn word embeddings that are resilient to misspellings. Existing word embeddings have limited applicability to malformed texts, which contain a non-negligible amount of out-of-vocabulary words. We propose a method combining FastText with subwords and a supervised task of learning misspelling patterns. In our method, misspellings of each word are embedded close to their correct variants. We train these embeddings on a new dataset we are releasing publicly. Finally, we experimentally show the advantages of this approach on both intrinsic and extrinsic NLP tasks using public test sets.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 3; 2023: 4; 2024: 4; 2025: 1.
19 papers.
Sort:
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentationcited by 72
- 2021Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Trainingcited by 21
- 2021On the Robustness of Intent Classification and Slot Labeling in Goal-oriented Dialog Systems to Real-world Noisecited by 9
- 2022Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Costcited by 9
- 2021Empirical Error Modeling Improves Robustness of Noisy Neural Sequence Labelingcited by 8
- 2023EDSA-Ensemble: an Event Detection Sentiment Analysis Ensemble Architecturecited by 8
- 2022Data-Driven Mitigation of Adversarial Text Perturbationcited by 5
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translationcited by 5
- 2021Towards Entity Alignment in the Open World: An Unsupervised Approachcited by 4
- 2022Analytical Engines With Context-Rich Processing: Towards Efficient Next-Generation Analyticscited by 4
- 2024Computational Models to Study Language Processing in the Human Brain: A Surveycited by 4
- 2025Misspellings in Natural Language Processing: A surveycited by 3
7 more
- 2021Robust Embeddings Via Distributionscited by 1
- 2023READIN: A Chinese Multi-Task Benchmark with Realistic and Diverse Input Noisescited by 1
- 2023A Comprehensive Empirical Evaluation of Existing Word Embedding Approachescited by 1
- 2023Optimizing Context-Enhanced Relational Joinscited by 1
- 2024Learning Robust Named Entity Recognizers From Noisy Data With Retrieval Augmentationcited by 1
- 2021Data Centric Domain Adaptation for Historical Text with OCR Errorscited by 0
- 2024Advancements in eHealth Data Analytics through Natural Language Processing and Deep Learningcited by 0
- 2025Misspellings in Natural Language Processing: A survey28 Jan 2025
- 2024Learning Robust Named Entity Recognizers From Noisy Data With Retrieval Augmentation26 Jul 2024
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translation25 Mar 2024
- 2024Computational Models to Study Language Processing in the Human Brain: A Survey20 Mar 2024
- 2024Advancements in eHealth Data Analytics through Natural Language Processing and Deep Learning19 Jan 2024
- 2023Optimizing Context-Enhanced Relational Joins3 Dec 2023
- 2023A Comprehensive Empirical Evaluation of Existing Word Embedding Approaches13 Mar 2023
- 2023READIN: A Chinese Multi-Task Benchmark with Realistic and Diverse Input Noises14 Feb 2023
- 2023EDSA-Ensemble: an Event Detection Sentiment Analysis Ensemble Architecture30 Jan 2023
- 2022Analytical Engines With Context-Rich Processing: Towards Efficient Next-Generation Analytics14 Dec 2022
- 2022Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost15 Mar 2022
- 2022Data-Driven Mitigation of Adversarial Text Perturbation19 Feb 2022
7 more
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation6 Dec 2021
- 2021Data Centric Domain Adaptation for Historical Text with OCR Errors2 Jul 2021
- 2021Empirical Error Modeling Improves Robustness of Noisy Neural Sequence Labeling25 May 2021
- 2021Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training17 Apr 2021
- 2021Robust Embeddings Via Distributions17 Apr 2021
- 2021On the Robustness of Intent Classification and Slot Labeling in Goal-oriented Dialog Systems to Real-world Noise14 Apr 2021
- 2021Towards Entity Alignment in the Open World: An Unsupervised Approach26 Jan 2021
- 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentationcited by 72
- 2021Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Trainingcited by 21
- 2021On the Robustness of Intent Classification and Slot Labeling in Goal-oriented Dialog Systems to Real-world Noisecited by 9
- 2022Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Costcited by 9
- 2021Empirical Error Modeling Improves Robustness of Noisy Neural Sequence Labelingcited by 8
- 2023EDSA-Ensemble: an Event Detection Sentiment Analysis Ensemble Architecturecited by 8
- 2022Data-Driven Mitigation of Adversarial Text Perturbationcited by 5
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translationcited by 5
- 2021Towards Entity Alignment in the Open World: An Unsupervised Approachcited by 4
- 2022Analytical Engines With Context-Rich Processing: Towards Efficient Next-Generation Analyticscited by 4
- 2024Computational Models to Study Language Processing in the Human Brain: A Surveycited by 4
- 2025Misspellings in Natural Language Processing: A surveycited by 3
12 most cited of 19 All 19 (JSON)
- 2025Misspellings in Natural Language Processing: A survey28 Jan 2025
- 2024Learning Robust Named Entity Recognizers From Noisy Data With Retrieval Augmentation26 Jul 2024
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translation25 Mar 2024
- 2024Computational Models to Study Language Processing in the Human Brain: A Survey20 Mar 2024
- 2024Advancements in eHealth Data Analytics through Natural Language Processing and Deep Learning19 Jan 2024
- 2023Optimizing Context-Enhanced Relational Joins3 Dec 2023
- 2023A Comprehensive Empirical Evaluation of Existing Word Embedding Approaches13 Mar 2023
- 2023READIN: A Chinese Multi-Task Benchmark with Realistic and Diverse Input Noises14 Feb 2023
- 2023EDSA-Ensemble: an Event Detection Sentiment Analysis Ensemble Architecture30 Jan 2023
- 2022Analytical Engines With Context-Rich Processing: Towards Efficient Next-Generation Analytics14 Dec 2022
- 2022Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost15 Mar 2022
- 2022Data-Driven Mitigation of Adversarial Text Perturbation19 Feb 2022
12 newest of 19 All 19 (JSON)