mlsanityData to 7 Oct 2026

From Classification to Generation: Insights into Crosslingual Retrieval Augmented ICL

arXiv 2311.06595 ↗First posted 11 Nov 2023cs.CLcited by 17

On the map: Retrieval-augmented generation → Generation and context integration

Abstract (arXiv)

The remarkable ability of Large Language Models (LLMs) to understand and follow instructions has sometimes been limited by their in-context learning (ICL) performance in low-resource languages. To address this, we introduce a novel approach that leverages cross-lingual retrieval-augmented in-context learning (CREA-ICL). By extracting semantically similar prompts from high-resource languages, we aim to improve the zero-shot performance of multilingual pre-trained language models (MPLMs) across diverse tasks. Though our approach yields steady improvements in classification tasks, it faces challenges in generation tasks. Our evaluation offers insights into the performance dynamics of retrieval-augmented in-context learning across both classification and generation domains.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 30 of its 44 references that are in the map. First posted on arXiv 11 Nov 2023.

Builds on

30 of 44 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023REPLUG: Retrieval-Augmented Black-Box Language Models30 Jan
  2. 2022Cross-Lingual Retrieval Augmented Prompt for Low-Resource Languages19 Dec
  3. 2022Novelty Controlled Paraphrase Generation with Retrieval Augmented Conditional Prompt Tuning1 Feb

Other references · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  7. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  8. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  9. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  10. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  11. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  12. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
15 more
  1. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
  2. 2019On the Cross-lingual Transferability of Monolingual Representationscited by 575
  3. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  4. 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 428
  5. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
  6. 2019On Measuring Social Biases in Sentence Encoderscited by 397
  7. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
  8. 2023MEGA: Multilingual Evaluation of Generative AIcited by 291
  9. 2019SemEval-2017 Task 4: Sentiment Analysis in Twittercited by 209
  10. 2023Multilingual LLMs are Better Cross-lingual In-context Learners with Alignmentcited by 71
  11. 2023BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfercited by 68
  12. 2021Discrete and Soft Prompting for Multilingual Modelscited by 49
  13. 2021One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrievalcited by 46
  14. 2022Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Promptcited by 25
  15. 2022Semantic-Oriented Unlabeled Priming for Large-Scale Language Modelscited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 5; 2025: 7; 2026: 4.

17 papers.

Sort:

By area:

  1. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  2. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
  3. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  4. 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 49
  5. 2025Test-Time Learning for Large Language Modelscited by 46
  6. 2025MMDocIR: Benchmarking Multimodal Retrieval for Long Documentscited by 43
  7. 2024Enhancing Retrieval and Managing Retrieval: A Four-Module Synergy for Improved Quality and Efficiency in RAG Systemscited by 15
  8. 2025Exploring the Security Threats of Knowledge Base Poisoning in Retrieval-Augmented Code Generationcited by 9
  9. 2025Adaptive Schema-aware Event Extraction with Retrieval-Augmented Generationcited by 7
  10. 2025Enhancing Cross-task Transfer of Large Language Models via Activation Steeringcited by 6
  11. 2026MemCollab: Cross-Model Memory Collaboration via Contrastive Trajectory Distillationcited by 6
  12. 2024Evaluating Implicit Bias in Large Language Models by Attacking From a Psychometric Perspectivecited by 5
5 more
  1. 2025LLM-based Corroborating and Refuting Evidence Retrieval for Scientific Claim Verificationcited by 5
  2. 2026Learning from Emptiness: De-biasing Listwise Rerankers with Content-Agnostic Probability Calibrationcited by 4
  3. 2025DoTA-RAG: Dynamic of Thought Aggregation RAGcited by 1
  4. 2026The Virtuous Cycle: AI-Powered Vector Search and Vector Search-Augmented AIcited by 0
  5. 2026Mask-to-Correct^+: Leveraging Retriever Diversity for Masking-guided Faithful Fact Correctioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Align, Generate, Learn: A Novel Closed-Loop Framework for Cross-Lingual In-Context Learning
  2. 2023Crosslingual Retrieval Augmented In-context Learning for Bangla
  3. 2025Eliciting In-context Retrieval and Reasoning for Long-context Large Language Models
  4. 2024Does In-Context Learning Really Learn? Rethinking How Large Language Models Respond and Solve Tasks via In-Context Learning
  5. 2025How and Where to Translate? The Impact of Translation Strategies in Cross-lingual LLM Prompting
  6. 2025On the Consistency of Multilingual Context Utilization in Retrieval-Augmented Generation
  7. 2024ICLERB: In-Context Learning Embedding and Reranker Benchmark
  8. 2025Multilingual Retrieval-Augmented Generation for Knowledge-Intensive Task