mlsanityData to 7 Oct 2026

Crosslingual Retrieval Augmented In-context Learning for Bangla

arXiv 2311.00587 ↗First posted 1 Nov 2023cs.CLcited by 7

On the map: Retrieval-augmented generation → Generation and context integration

Abstract (arXiv)

The promise of Large Language Models (LLMs) in Natural Language Processing has often been overshadowed by their limited performance in low-resource languages such as Bangla. To address this, our paper presents a pioneering approach that utilizes cross-lingual retrieval augmented in-context learning. By strategically sourcing semantically similar prompts from high-resource language, we enable multilingual pretrained language models (MPLMs), especially the generative model BLOOMZ, to successfully boost performance on Bangla tasks. Our extensive evaluation highlights that the cross-lingual retrieval augmented prompts bring steady improvements to MPLMs over the zero-shot performance.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 25 of its 50 references that are in the map. First posted on arXiv 1 Nov 2023.

Builds on

25 of 50 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023REPLUG: Retrieval-Augmented Black-Box Language Models30 Jan

Other references · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  7. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  8. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  9. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  10. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
  11. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  12. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
12 more
  1. 2023MEGA: Multilingual Evaluation of Generative AIcited by 291
  2. 2019SemEval-2017 Task 4: Sentiment Analysis in Twittercited by 209
  3. 2021BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Banglacited by 123
  4. 2023Multilingual LLMs are Better Cross-lingual In-context Learners with Alignmentcited by 71
  5. 2023BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfercited by 68
  6. 2021Discrete and Soft Prompting for Multilingual Modelscited by 49
  7. 2020Classification Benchmarks for Under-resourced Bengali Language based on Multichannel Convolutional-LSTM Networkcited by 30
  8. 2022Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Promptcited by 25
  9. 2023Zero- and Few-Shot Prompting with LLMs: A Comparative Study with Fine-tuned Models for Bangla Sentiment Analysiscited by 20
  10. 2022Semantic-Oriented Unlabeled Priming for Large-Scale Language Modelscited by 12
  11. 2023SentiGOLD: A Large Bangla Gold Standard Multi-Domain Sentiment Analysis Dataset and its Evaluationcited by 8
  12. 2014Supervised learning Methods for Bangla Web Document Categorizationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 2; 2026: 2.

7 papers.

  1. 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 49
  2. 2024Manipulating Large Language Models to Increase Product Visibilitycited by 24
  3. 2024Exploring the Role of Transliteration in In-Context Learning for Low-resource Languages Written in Non-Latin Scriptscited by 8
  4. 2025Mechanistic Understanding and Mitigation of Language Confusion in English-Centric Large Language Modelscited by 8
  5. 2025LegalRAG: A Hybrid RAG System for Multilingual Legal Information Retrievalcited by 5
  6. 2026The Virtuous Cycle: AI-Powered Vector Search and Vector Search-Augmented AIcited by 0
  7. 2026When Less Is Enough: Context Selection and Prompting Strategies for Bengali News Headline Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023From Classification to Generation: Insights into Crosslingual Retrieval Augmented ICL
  2. 2022Cross-Lingual Retrieval Augmented Prompt for Low-Resource Languages
  3. 2024Align, Generate, Learn: A Novel Closed-Loop Framework for Cross-Lingual In-Context Learning
  4. 2025How and Where to Translate? The Impact of Translation Strategies in Cross-lingual LLM Prompting
  5. 2023Bridging the Language Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs
  6. 2023Retrieval meets Long Context Large Language Models
  7. 2025Improving Retrieval-Augmented Neural Machine Translation with Monolingual Data
  8. 2024Transforming LLMs into Cross-modal and Cross-lingual Retrieval Systems