mlsanityData to 7 Oct 2026

BSharedRAG: Backbone Shared Retrieval-Augmented Generation for the E-commerce Domain

arXiv 2409.20075 ↗First posted 30 Sep 2024cs.CLcited by 4

On the map: Retrieval-augmented generation → RAG pipeline design and evaluation

Abstract (arXiv)

Retrieval Augmented Generation (RAG) system is important in domains such as e-commerce, which has many long-tail entities and frequently updated information. Most existing works adopt separate modules for retrieval and generation, which may be suboptimal since the retrieval task and the generation task cannot benefit from each other to improve performance. We propose a novel Backbone Shared RAG framework (BSharedRAG). It first uses a domain-specific corpus to continually pre-train a base model as a domain-specific backbone model and then trains two plug-and-play Low-Rank Adaptation (LoRA) modules based on the shared backbone to minimize retrieval and generation losses respectively. Experimental results indicate that our proposed BSharedRAG outperforms baseline models by 5% and 13% in Hit@3 upon two datasets in retrieval evaluation and by 23% in terms of BLEU-3 in generation evaluation. Our codes, models, and dataset are available at https://bsharedrag.github.io.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 38 of its 52 references that are in the map. First posted on arXiv 30 Sep 2024.

Builds on

38 of 52 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Retrieval-Augmented Generation for AI-Generated Content: A Survey29 Feb
  2. 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec

Other references · 36

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  7. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  8. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  9. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  10. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  11. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  12. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
24 more
  1. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  2. 2023In-Context Retrieval-Augmented Language Modelscited by 694
  3. 2023Baichuan 2: Open Large-scale Language Modelscited by 664
  4. 2020Knowledge Graphscited by 619
  5. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 357
  6. 2023Large Language Models for Information Retrieval: A Surveycited by 331
  7. 2023Fine-Tuning LLaMA for Multi-Stage Text Retrievalcited by 271
  8. 2024RAFT: Adapting Language Model to Domain Specific RAGcited by 258
  9. 2024Generative Representational Instruction Tuningcited by 227
  10. 2023Continual Pre-training of Language Modelscited by 194
  11. 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 194
  12. 2020The Effect of Natural Distribution Shift on Question Answering Modelscited by 104
  13. 2023EcomGPT: Instruction-tuning Large Language Models with Chain-of-Task Tasks for E-commercecited by 48
  14. 2024eCeLLM: Generalizing Large Language Models for E-commerce from Large-scale, High-quality Instruction Datacited by 44
  15. 2019AmazonQA: A Review-Based Question Answering Taskcited by 43
  16. 2019Product-Aware Answer Generation in E-Commerce Question-Answeringcited by 27
  17. 2022Multi-CPR: A Multi Domain Chinese Dataset for Passage Retrievalcited by 26
  18. 2020SubjQA: A Dataset for Subjectivity and Review Comprehensioncited by 24
  19. 2016Modeling Ambiguity, Subjectivity, and Diverging Viewpoints in Opinion Question Answering Systemscited by 15
  20. 2023IAG: Induction-Augmented Generation Framework for Answering Reasoning Questionscited by 15
  21. 2019Review-Driven Answer Generation for Product-Related Questions in E-Commercecited by 10
  22. 2023Product Question Answering in E-Commerce: A Surveycited by 10
  23. 2023xPQA: Cross-Lingual Product Question Answering across 12 Languagescited by 10
  24. 2023Hallucination Detection for Grounded Instruction Generationcited by 7

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024XRAG: eXamining the Core -- Benchmarking Foundational Components in Advanced Retrieval-Augmented Generation
  2. 2024Towards Optimizing a Retrieval Augmented Generation using Large Language Model on Academic Data
  3. 2024AutoRAG: Automated Framework for optimization of Retrieval Augmented Generation Pipeline
  4. 2024RAG Foundry: A Framework for Enhancing LLMs for Retrieval Augmented Generation
  5. 2024Graph Retrieval-Augmented Generation: A Survey
  6. 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Research
  7. 2024RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systems
  8. 2026GuidedRAG: Semantic Steering of Retrieval-Augmented Generation