mlsanityData to 7 Oct 2026

GPTs Are Multilingual Annotators for Sequence Generation Tasks

arXiv 2402.05512 ↗First posted 8 Feb 2024cs.CL cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

Data annotation is an essential step for constructing new datasets. However, the conventional approach of data annotation through crowdsourcing is both time-consuming and expensive. In addition, the complexity of this process increases when dealing with low-resource languages owing to the difference in the language pool of crowdworkers. To address these issues, this study proposes an autonomous annotation method by utilizing large language models, which have been recently demonstrated to exhibit remarkable performance. Through our experiments, we demonstrate that the proposed method is not just cost-efficient but also applicable for low-resource language annotation. Additionally, we constructed an image captioning dataset using our approach and are committed to open this dataset for future study. We have opened our source code for further study and reproducibility.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 43 of its 70 references that are in the map. First posted on arXiv 8 Feb 2024.

Builds on

43 of 70 references.

References · 43

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  6. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  7. 2022Training language models to follow instructions with human feedbackcited by 15,712
  8. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  9. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  10. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  11. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  12. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
31 more
  1. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  2. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
  3. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  4. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  5. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  6. 2020Pre-trained Models for Natural Language Processing: A Surveycited by 504
  7. 2017Beam Search Strategies for Neural Machine Translationcited by 232
  8. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 209
  9. 2022ZeroGen: Efficient Zero-shot Learning via Dataset Generationcited by 209
  10. 2022Is GPT-3 a Good Data Annotator?cited by 208
  11. 2021Want To Reduce Labeling Cost? GPT-3 Can Helpcited by 196
  12. 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 185
  13. 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 172
  14. 2023AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotatorscited by 171
  15. 2018Meta-Learning for Low-Resource Neural Machine Translationcited by 105
  16. 2023CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotationcited by 93
  17. 2023LLMaAA: Making Large Language Models as Active Annotatorscited by 78
  18. 2017Relevance of Unsupervised Metrics in Task-Oriented Dialogue for Evaluating Natural Language Generationcited by 61
  19. 2019Revisiting Low-Resource Neural Machine Translation: A Case Studycited by 61
  20. 2021XFORMAL: A Benchmark for Multilingual Formality Style Transfercited by 51
  21. 2023ChatGPT: A Meta-Analysis after 2.5 Monthscited by 50
  22. 2021Transparent Human Evaluation for Image Captioningcited by 40
  23. 2023Open, Closed, or Small Language Models for Text Classification?cited by 34
  24. 2023Large Language Models as Annotators: Enhancing Generalization of NLP Models at Minimal Costcited by 33
  25. 2022Hierarchical Sketch Induction for Paraphrase Generationcited by 21
  26. 2019Evaluation of Sentence Representations in Polishcited by 18
  27. 2023Unraveling ChatGPT: A Critical Analysis of AI-Generated Goal-Oriented Dialogues and Annotationscited by 14
  28. 2020UIT-ViIC: A Dataset for the First Evaluation on Vietnamese Image Captioningcited by 13
  29. 2022This is the way: designing and compiling LEPISZCZE, a comprehensive NLP benchmark for Polishcited by 13
  30. 2019SANTLR: Speech Annotation Toolkit for Low Resource Languagescited by 5
  31. 2020Improving Multilingual Neural Machine Translation For Low-Resource Languages: French,English - Vietnamesecited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 4; 2026: 1.

11 papers.

  1. 2024Multi-News+: Cost-efficient Dataset Cleansing via LLM-based Data Annotationcited by 16
  2. 2025Evaluating Large Language Models as Expert Annotatorscited by 9
  3. 2025Text-to-SQL Domain Adaptation via Human-LLM Collaborative Data Annotationcited by 6
  4. 2025Prompt Candidates, then Distill: A Teacher-Student Framework for LLM-driven Data Annotationcited by 5
  5. 2024VolDoGer: LLM-assisted Datasets for Domain Generalization in Vision-Language Taskscited by 3
  6. 2024Are Expert-Level Language Models Expert-Level Annotators?cited by 3
  7. 2026Tracing the Data Trail: A Survey of Data Provenance, Transparency and Traceability in LLMscited by 3
  8. 2024Real-time Speech Summarization for Medical Conversationscited by 2
  9. 2024From Test-Taking to Test-Making: Examining LLM Authoring of Commonsense Assessment Itemscited by 2
  10. 2024Structured List-Grounded Question Answeringcited by 0
  11. 2025LVLMs as inspectors: an agentic framework for category-level structural defect annotationcited by 0