mlsanityData to 7 Oct 2026

Redefining Information Retrieval of Structured Database via Large Language Models

arXiv 2405.05508 ↗First posted 9 May 2024cs.IR cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Retrieval augmentation is critical when Language Models (LMs) exploit non-parametric knowledge related to the query through external knowledge bases before reasoning. The retrieved information is incorporated into LMs as context alongside the query, enhancing the reliability of responses towards factual questions. Prior researches in retrieval augmentation typically follow a retriever-generator paradigm. In this context, traditional retrievers encounter challenges in precisely and seamlessly extracting query-relevant information from knowledge bases. To address this issue, this paper introduces a novel retrieval augmentation framework called ChatLR that primarily employs the powerful semantic understanding ability of Large Language Models (LLMs) as retrievers to achieve precise and concise information retrieval. Additionally, we construct an LLM-based search and question answering system tailored for the financial domain by fine-tuning LLM on two tasks including Text2API and API-ID recognition. Experimental results demonstrate the effectiveness of ChatLR in addressing user queries, achieving an overall information retrieval accuracy exceeding 98.8%.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 43 of its 53 references that are in the map. First posted on arXiv 9 May 2024.

Builds on

43 of 53 references.

References · 43

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  7. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  8. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  9. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  10. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  11. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  12. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
31 more
  1. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  2. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  3. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
  4. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
  5. 2023LIMA: Less Is More for Alignmentcited by 1,080
  6. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  7. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
  8. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  9. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  10. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  11. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  12. 2023In-Context Retrieval-Augmented Language Modelscited by 694
  13. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 691
  14. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
  15. 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 509
  16. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
  17. 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 465
  18. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
  19. 2020A Simple Language Model for Task-Oriented Dialoguecited by 331
  20. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 303
  21. 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 302
  22. 2023MathPrompter: Mathematical Reasoning using Large Language Modelscited by 236
  23. 2021TAPEX: Table Pre-training via Learning a Neural SQL Executorcited by 233
  24. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
  25. 2020Distilling Knowledge from Reader to Retriever for Question Answeringcited by 226
  26. 2020Open Question Answering over Tables and Textcited by 163
  27. 2019Challenges in Building Intelligent Open-domain Dialog Systemscited by 147
  28. 2019A Comprehensive Exploration on WikiSQL with Table-Aware Word Contextualizationcited by 88
  29. 2023Exploring the Impact of Instruction Data Scaling on Large Language Models: An Empirical Study on Real-World Use Casescited by 85
  30. 2023Augmentation-Adapted Retriever Improves Generalization of Language Models as Generic Plug-Incited by 71
  31. 2023ChatHome: Development and Evaluation of a Domain-Specific Language Model for Home Renovationcited by 25

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.