mlsanityData to 14 Oct 2026

A Study on the Implementation of Generative AI Services Using an Enterprise Data-Based LLM Application Architecture

arXiv 2309.01105 ↗First posted 3 Sep 2023cs.AI cs.CLcited by 28

On the map: Retrieval-augmented generation → RAG pipeline design and evaluation

Abstract (arXiv)

This study presents a method for implementing generative AI services by utilizing the Large Language Models (LLM) application architecture. With recent advancements in generative AI technology, LLMs have gained prominence across various domains. In this context, the research addresses the challenge of information scarcity and proposes specific remedies by harnessing LLM capabilities. The investigation delves into strategies for mitigating the issue of inadequate data, offering tailored solutions. The study delves into the efficacy of employing fine-tuning techniques and direct document integration to alleviate data insufficiency. A significant contribution of this work is the development of a Retrieval-Augmented Generation (RAG) model, which tackles the aforementioned challenges. The RAG model is carefully designed to enhance information storage and retrieval processes, ensuring improved content generation. The research elucidates the key phases of the information storage and retrieval methodology underpinned by the RAG model. A comprehensive analysis of these steps is undertaken, emphasizing their significance in addressing the scarcity of data. The study highlights the efficacy of the proposed method, showcasing its applicability through illustrative instances. By implementing the RAG model for information storage and retrieval, the research not only contributes to a deeper comprehension of generative AI technology but also facilitates its practical usability within enterprises utilizing LLMs. This work holds substantial value in advancing the field of generative AI, offering insights into enhancing data-driven content generation and fostering active utilization of LLM-based services within corporate settings.

Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 2 of its 38 references that are in the map. First posted on arXiv 3 Sep 2023.

Builds on

2 of 38 references.

References · 2

  1. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  2. 2023A Survey of Large Language Modelscited by 2,576

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 12; 2025: 12; 2026: 4.

28 papers.

Sort:

By area:

  1. 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Surveycited by 128
  2. 2024FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAscited by 64
  3. 2024Fine-tuning and Utilization Methods of Domain-specific LLMscited by 36
  4. 2024Fine Tuning LLM for Enterprise: Practical Guidelines and Recommendationscited by 28
  5. 2025Evaluating LLM Metrics Through Real-World Capabilitiescited by 18
  6. 2024Leveraging Logical Rules in Knowledge Editing: A Cherry on the Topcited by 12
  7. 2024A Study on the Implementation Method of an Agent-Based Advanced RAG System Using Graphcited by 8
  8. 2025A Study on the MCP x A2A Framework for Enhancing Interoperability of LLM-based Autonomous Agentscited by 8
  9. 2026MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documentscited by 6
  10. 2025Beyond Text: Implementing Multimodal Large Language Model-Powered Multi-Agent Systems Using a No-Code Platformcited by 5
  11. 2025E2E Process Automation Leveraging Generative AI and IDP-Based Automation Agent: A Case Study on Corporate Expense Processingcited by 5
  12. 2024Dynamic Multi-Agent Orchestration and Retrieval for Multi-Source Question-Answer Systems using Large Language Modelscited by 3
16 more
  1. 2026HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answeringcited by 3
  2. 2024SecGenAI: Enhancing Security of Cloud-based Generative AI Applications within Australian Critical Technologies of National Interestcited by 2
  3. 2025A Study on the Framework for Evaluating the Ethics and Trustworthiness of Generative AIcited by 2
  4. 2024The future of document indexing: GPT and Donut revolutionize table of content processingcited by 1
  5. 2024LLM-R: A Framework for Domain-Adaptive Maintenance Scheme Generation Combining Hierarchical Agents and RAGcited by 1
  6. 2024Contrato360 2.0: A Document and Database-Driven Question-Answer System using Large Language Models and Agentscited by 1
  7. 2025Dr. GPT Will See You Now, but Should It? Exploring the Benefits and Harms of Large Language Models in Medical Diagnosis using Crowdsourced Clinical Casescited by 1
  8. 2025Data Quality Challenges in Retrieval-Augmented Generationcited by 1
  9. 2025GRAPH-GRPO-LEX: Contract Graph Modeling and Reinforcement Learning with Group Relative Policy Optimizationcited by 1
  10. 2026Predictive Prototyping: Evaluating Design Concepts with ChatGPTcited by 1
  11. 2024EventChat: Implementation and user-centric evaluation of a large language model-driven conversational recommender system for exploring leisure events in an SME contextcited by 0
  12. 2025Open-Source Retrieval Augmented Generation Framework for Retrieving Accurate Medication Insights from Formularies for African Healthcare Workerscited by 0
  13. 2025Accodemy: AI Powered Code Learning Platform to Assist Novice Programmers in Overcoming the Fear of Codingcited by 0
  14. 2025LLM Chatbot-Creation Approachescited by 0
  15. 2025Modeling User-System Behavior for Training-free Building of Private Domain Conversational Agentscited by 0
  16. 2026M3DocDep: Multi-modal, Multi-page, Multi-document Dependency Chunking with Large Vision-Language Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Developing Retrieval Augmented Generation (RAG) based LLM Systems from PDFs: An Experience Report
  2. 2024Deploying Large Language Models With Retrieval Augmented Generation
  3. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models
  4. 2024Retrieval-Augmented Generation for AI-Generated Content: A Survey
  5. 2025Retrieval-Augmented Generation in Industry: An Interview Study on Use Cases, Requirements, Challenges, and Evaluation
  6. 2024A Collaborative Multi-Agent Approach to Retrieval-Augmented Generation Across Diverse Data
  7. 2024The Power of Noise: Redefining Retrieval for RAG Systems
  8. 2024ERATTA: Extreme RAG for Table To Answers with Large Language Models