mlsanityData to 7 Oct 2026

Location-based Twitter Filtering for the Creation of Low-Resource Language Datasets in Indonesian Local Languages

arXiv 2206.07238 ↗First posted 15 Jun 2022cs.CL cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Twitter contains an abundance of linguistic data from the real world. We examine Twitter for user-generated content in low-resource languages such as local Indonesian. For NLP to work in Indonesian, it must consider local dialects, geographic context, and regional culture influence Indonesian languages. This paper identifies the problems we faced when constructing a Local Indonesian NLP dataset. Furthermore, we are developing a framework for creating, collecting, and classifying Local Indonesian datasets for NLP. Using twitter's geolocation tool for automatic annotating.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 45 references that are in the map. First posted on arXiv 15 Jun 2022.

Builds on

15 of 45 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  4. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  5. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
  6. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  7. 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 844
  8. 2016FastText.zip: Compressing text classification modelscited by 331
  9. 2020IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understandingcited by 108
  10. 2022One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesiacited by 65
  11. 2020IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLPcited by 57
  12. 2021IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initializationcited by 25
3 more
  1. 2020Towards Computational Linguistics in Minangkabau Language: Studies on Sentiment Analysis and Machine Translationcited by 16
  2. 2020Cross-Lingual Machine Speech Chain for Javanese, Sundanese, Balinese, and Bataks Speech Recognition and Synthesiscited by 8
  3. 2020Spoken dialect identification in Twitter using a multi-filter architecturecited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.

  1. 2024Constructing and Expanding Low-Resource and Underrepresented Parallel Datasets for Indonesian Local Languagescited by 3