Explanation based In-Context Demonstrations Retrieval for Multilingual Grammatical Error Correction
Not on the map. Why?
Abstract (arXiv)
Grammatical error correction (GEC) aims to correct grammatical, spelling, and semantic errors in natural language text. With the growing of large language models (LLMs), direct text generation has gradually become the focus of the GEC methods, and few-shot in-context learning presents a cost-effective solution. However, selecting effective in-context examples remains challenging, as the similarity between input texts does not necessarily correspond to similar grammatical error patterns. In this paper, we propose a novel retrieval method based on natural language grammatical error explanations (GEE) to address this issue. Our method retrieves suitable few-shot demonstrations by matching the GEE of the test input with that of pre-constructed database samples, where explanations for erroneous samples are generated by LLMs. We conducted multilingual GEC few-shot experiments on both major open-source and closed-source LLMs. Experiments across five languages show that our method outperforms existing semantic and BM25-based retrieval techniques, without requiring additional training or language adaptation. This also suggests that matching error patterns is key to selecting examples.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 34 of its 58 references that are in the map. First posted on arXiv 12 Feb 2025.
Builds on
34 of 58 references.
References · 34
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,392
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,135
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 388
22 more
- 2022Selective Annotation Makes Language Models Better Few-Shot Learnerscited by 243
- 2020Nearest Neighbor Machine Translationcited by 209
- 2020GECToR -- Grammatical Error Correction: Tag, Not Rewritecited by 177
- 2022In-context Examples Selection for Machine Translationcited by 172
- 2022Pretrained Language Models for Text Generation: A Surveycited by 122
- 2021A Simple Recipe for Multilingual Grammatical Error Correctioncited by 108
- 2019Parallel Iterative Edit Models for Local Sequence Transductioncited by 81
- 2023Dr.ICL: Demonstration-Retrieved In-context Learningcited by 72
- 2024In-context Learning with Retrieved Demonstrations for Language Models: A Surveycited by 70
- 2018Approaching Neural Grammatical Error Correction as a Low-Resource Machine Translation Taskcited by 56
- 2023Exploring Effectiveness of GPT-3 in Grammatical Error Correction: A Study on Performance and Controllability in Prompt-Based Methodscited by 37
- 2020Stronger Baselines for Grammatical Error Correction Using Pretrained Encoder-Decoder Modelcited by 33
- 2022SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parsercited by 32
- 2023On the application of Large Language Models for language teaching and assessment technologycited by 27
- 2024Prompting open-source and commercial language models for grammatical error correction of English learner textcited by 24
- 2023GrammarGPT: Exploring Open-Source LLMs for Native Chinese Grammatical Error Correction with Supervised Fine-Tuningcited by 23
- 2023Enhancing Grammatical Error Correction Systems with Explanationscited by 19
- 2022A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Modelcited by 16
- 2023GEE! Grammar Error Explanation with Large Language Modelscited by 15
- 2024mEdIT: Multilingual Text Editing via Instruction Tuningcited by 13
- 2022Type-Driven Multi-Turn Corrections for Grammatical Error Correctioncited by 9
- 2024Evaluating Prompting Strategies for Grammatical Error Correction Based on Language Proficiencycited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.