Charagram: Embedding Words and Sentences via Character n-grams
Not on the map. Why?
Abstract (arXiv)
We present Charagram embeddings, a simple approach for learning character-based compositional models to embed textual sequences. A word or sentence is represented using a character n-gram count vector, followed by a single nonlinear transformation to yield a low-dimensional embedding. We use three tasks for evaluation: word similarity, sentence similarity, and part-of-speech tagging. We demonstrate that Charagram embeddings outperform more complex architectures based on character-level recurrent and convolutional neural networks, achieving new state-of-the-art performance on several similarity tasks.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jul 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 3; 2023: 3; 2024: 1; 2025: 1.
14 papers.
Sort:
- 2021CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representationcited by 229
- 2021Dynamic Language Models for Continuously Evolving Contentcited by 27
- 2023Text Rendering Strategies for Pixel Language Modelscited by 22
- 2024Large Language Models Lack Understanding of Character Composition of Wordscited by 21
- 2021Paraphrastic Representations at Scalecited by 19
- 2022Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Costcited by 9
- 2021Evaluating Neural Word Embeddings for Sanskritcited by 8
- 2023SanskritShala: A Neural Sanskrit NLP Toolkit with Web-Based Interface for Pedagogical and Annotation Purposescited by 5
- 2021Integrating Approaches to Word Representationcited by 4
- 2021Explaining Natural Language Processing Classifiers with Occlusion and Language Modelingcited by 2
- 2023Linguistically-Informed Neural Architectures for Lexical, Syntactic and Semantic Tasks in Sanskritcited by 1
- 20221Cademy at Semeval-2022 Task 1: Investigating the Effectiveness of Multilingual, Multitask, and Language-Agnostic Tricks for the Reverse Dictionary Taskcited by 0
- 2025Handling Korean Out-of-Vocabulary Words with Phoneme Representation Learning5 Jul 2025
- 2024Large Language Models Lack Understanding of Character Composition of Words18 May 2024
- 2023Text Rendering Strategies for Pixel Language Models1 Nov 2023
- 2023Linguistically-Informed Neural Architectures for Lexical, Syntactic and Semantic Tasks in Sanskrit17 Aug 2023
- 2023SanskritShala: A Neural Sanskrit NLP Toolkit with Web-Based Interface for Pedagogical and Annotation Purposes19 Feb 2023
- 2022Efficient Entity Candidate Generation for Low-Resource Languages30 Jun 2022
- 20221Cademy at Semeval-2022 Task 1: Investigating the Effectiveness of Multilingual, Multitask, and Language-Agnostic Tricks for the Reverse Dictionary Task8 Jun 2022
- 2022Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost15 Mar 2022
- 2021Integrating Approaches to Word Representation10 Sep 2021
- 2021Dynamic Language Models for Continuously Evolving Content11 Jun 2021
- 2021Paraphrastic Representations at Scale30 Apr 2021
- 2021Evaluating Neural Word Embeddings for Sanskrit1 Apr 2021
- 2021CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representationcited by 229
- 2021Dynamic Language Models for Continuously Evolving Contentcited by 27
- 2023Text Rendering Strategies for Pixel Language Modelscited by 22
- 2024Large Language Models Lack Understanding of Character Composition of Wordscited by 21
- 2021Paraphrastic Representations at Scalecited by 19
- 2022Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Costcited by 9
- 2021Evaluating Neural Word Embeddings for Sanskritcited by 8
- 2023SanskritShala: A Neural Sanskrit NLP Toolkit with Web-Based Interface for Pedagogical and Annotation Purposescited by 5
- 2021Integrating Approaches to Word Representationcited by 4
- 2021Explaining Natural Language Processing Classifiers with Occlusion and Language Modelingcited by 2
- 2023Linguistically-Informed Neural Architectures for Lexical, Syntactic and Semantic Tasks in Sanskritcited by 1
- 20221Cademy at Semeval-2022 Task 1: Investigating the Effectiveness of Multilingual, Multitask, and Language-Agnostic Tricks for the Reverse Dictionary Taskcited by 0
12 most cited of 14 All 14 (JSON)
- 2025Handling Korean Out-of-Vocabulary Words with Phoneme Representation Learning5 Jul 2025
- 2024Large Language Models Lack Understanding of Character Composition of Words18 May 2024
- 2023Text Rendering Strategies for Pixel Language Models1 Nov 2023
- 2023Linguistically-Informed Neural Architectures for Lexical, Syntactic and Semantic Tasks in Sanskrit17 Aug 2023
- 2023SanskritShala: A Neural Sanskrit NLP Toolkit with Web-Based Interface for Pedagogical and Annotation Purposes19 Feb 2023
- 2022Efficient Entity Candidate Generation for Low-Resource Languages30 Jun 2022
- 20221Cademy at Semeval-2022 Task 1: Investigating the Effectiveness of Multilingual, Multitask, and Language-Agnostic Tricks for the Reverse Dictionary Task8 Jun 2022
- 2022Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost15 Mar 2022
- 2021Integrating Approaches to Word Representation10 Sep 2021
- 2021Dynamic Language Models for Continuously Evolving Content11 Jun 2021
- 2021Paraphrastic Representations at Scale30 Apr 2021
- 2021Evaluating Neural Word Embeddings for Sanskrit1 Apr 2021
12 newest of 14 All 14 (JSON)