A Study on the Implementation of Generative AI Services Using an Enterprise Data-Based LLM Application Architecture
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
This study presents a method for implementing generative AI services by utilizing the Large Language Models (LLM) application architecture. With recent advancements in generative AI technology, LLMs have gained prominence across various domains. In this context, the research addresses the challenge of information scarcity and proposes specific remedies by harnessing LLM capabilities. The investigation delves into strategies for mitigating the issue of inadequate data, offering tailored solutions. The study delves into the efficacy of employing fine-tuning techniques and direct document integration to alleviate data insufficiency. A significant contribution of this work is the development of a Retrieval-Augmented Generation (RAG) model, which tackles the aforementioned challenges. The RAG model is carefully designed to enhance information storage and retrieval processes, ensuring improved content generation. The research elucidates the key phases of the information storage and retrieval methodology underpinned by the RAG model. A comprehensive analysis of these steps is undertaken, emphasizing their significance in addressing the scarcity of data. The study highlights the efficacy of the proposed method, showcasing its applicability through illustrative instances. By implementing the RAG model for information storage and retrieval, the research not only contributes to a deeper comprehension of generative AI technology but also facilitates its practical usability within enterprises utilizing LLMs. This work holds substantial value in advancing the field of generative AI, offering insights into enhancing data-driven content generation and fostering active utilization of LLM-based services within corporate settings.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 2 of its 38 references that are in the map. First posted on arXiv 3 Sep 2023.
Builds on
2 of 38 references.
References · 2
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2023A Survey of Large Language Modelscited by 2,576
Built on by
Citing papers per year: 2024: 12; 2025: 12; 2026: 4.
28 papers.
Sort:
By area:
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Surveycited by 128
- 2024FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAscited by 64
- 2024Fine-tuning and Utilization Methods of Domain-specific LLMscited by 36
- 2024Fine Tuning LLM for Enterprise: Practical Guidelines and Recommendationscited by 28
- 2025Evaluating LLM Metrics Through Real-World Capabilitiescited by 18
- 2024Leveraging Logical Rules in Knowledge Editing: A Cherry on the Topcited by 12
- 2024A Study on the Implementation Method of an Agent-Based Advanced RAG System Using Graphcited by 8
- 2025A Study on the MCP x A2A Framework for Enhancing Interoperability of LLM-based Autonomous Agentscited by 8
- 2026MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documentscited by 6
- 2025Beyond Text: Implementing Multimodal Large Language Model-Powered Multi-Agent Systems Using a No-Code Platformcited by 5
- 2025E2E Process Automation Leveraging Generative AI and IDP-Based Automation Agent: A Case Study on Corporate Expense Processingcited by 5
- 2024Dynamic Multi-Agent Orchestration and Retrieval for Multi-Source Question-Answer Systems using Large Language Modelscited by 3
16 more
- 2026HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answeringcited by 3
- 2024SecGenAI: Enhancing Security of Cloud-based Generative AI Applications within Australian Critical Technologies of National Interestcited by 2
- 2025A Study on the Framework for Evaluating the Ethics and Trustworthiness of Generative AIcited by 2
- 2024The future of document indexing: GPT and Donut revolutionize table of content processingcited by 1
- 2024LLM-R: A Framework for Domain-Adaptive Maintenance Scheme Generation Combining Hierarchical Agents and RAGcited by 1
- 2024Contrato360 2.0: A Document and Database-Driven Question-Answer System using Large Language Models and Agentscited by 1
- 2025Dr. GPT Will See You Now, but Should It? Exploring the Benefits and Harms of Large Language Models in Medical Diagnosis using Crowdsourced Clinical Casescited by 1
- 2025Data Quality Challenges in Retrieval-Augmented Generationcited by 1
- 2025GRAPH-GRPO-LEX: Contract Graph Modeling and Reinforcement Learning with Group Relative Policy Optimizationcited by 1
- 2026Predictive Prototyping: Evaluating Design Concepts with ChatGPTcited by 1
- 2024EventChat: Implementation and user-centric evaluation of a large language model-driven conversational recommender system for exploring leisure events in an SME contextcited by 0
- 2025Open-Source Retrieval Augmented Generation Framework for Retrieving Accurate Medication Insights from Formularies for African Healthcare Workerscited by 0
- 2025Accodemy: AI Powered Code Learning Platform to Assist Novice Programmers in Overcoming the Fear of Codingcited by 0
- 2025LLM Chatbot-Creation Approachescited by 0
- 2025Modeling User-System Behavior for Training-free Building of Private Domain Conversational Agentscited by 0
- 2026M3DocDep: Multi-modal, Multi-page, Multi-document Dependency Chunking with Large Vision-Language Modelscited by 0
- 2026HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answering28 May 2026
- 2026M3DocDep: Multi-modal, Multi-page, Multi-document Dependency Chunking with Large Vision-Language Models17 Apr 2026
- 2026MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documents14 Apr 2026
- 2026Predictive Prototyping: Evaluating Design Concepts with ChatGPT18 Jan 2026
- 2025Modeling User-System Behavior for Training-free Building of Private Domain Conversational Agents13 Nov 2025
- 2025GRAPH-GRPO-LEX: Contract Graph Modeling and Reinforcement Learning with Group Relative Policy Optimization10 Nov 2025
- 2025Data Quality Challenges in Retrieval-Augmented Generation1 Oct 2025
- 2025A Study on the Framework for Evaluating the Ethics and Trustworthiness of Generative AI30 Aug 2025
- 2025LLM Chatbot-Creation Approaches28 Aug 2025
- 2025Dr. GPT Will See You Now, but Should It? Exploring the Benefits and Harms of Large Language Models in Medical Diagnosis using Crowdsourced Clinical Cases13 Jun 2025
- 2025A Study on the MCP x A2A Framework for Enhancing Interoperability of LLM-based Autonomous Agents2 Jun 2025
- 2025E2E Process Automation Leveraging Generative AI and IDP-Based Automation Agent: A Case Study on Corporate Expense Processing27 May 2025
16 more
- 2025Evaluating LLM Metrics Through Real-World Capabilities13 May 2025
- 2025Accodemy: AI Powered Code Learning Platform to Assist Novice Programmers in Overcoming the Fear of Coding9 Mar 2025
- 2025Open-Source Retrieval Augmented Generation Framework for Retrieving Accurate Medication Insights from Formularies for African Healthcare Workers28 Jan 2025
- 2025Beyond Text: Implementing Multimodal Large Language Model-Powered Multi-Agent Systems Using a No-Code Platform1 Jan 2025
- 2024Dynamic Multi-Agent Orchestration and Retrieval for Multi-Source Question-Answer Systems using Large Language Models23 Dec 2024
- 2024Contrato360 2.0: A Document and Database-Driven Question-Answer System using Large Language Models and Agents23 Dec 2024
- 2024LLM-R: A Framework for Domain-Adaptive Maintenance Scheme Generation Combining Hierarchical Agents and RAG7 Nov 2024
- 2024A Study on the Implementation Method of an Agent-Based Advanced RAG System Using Graph29 Jul 2024
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Survey9 Jul 2024
- 2024EventChat: Implementation and user-centric evaluation of a large language model-driven conversational recommender system for exploring leisure events in an SME context5 Jul 2024
- 2024SecGenAI: Enhancing Security of Cloud-based Generative AI Applications within Australian Critical Technologies of National Interest1 Jul 2024
- 2024Leveraging Logical Rules in Knowledge Editing: A Cherry on the Top24 May 2024
- 2024Fine Tuning LLM for Enterprise: Practical Guidelines and Recommendations23 Mar 2024
- 2024The future of document indexing: GPT and Donut revolutionize table of content processing12 Mar 2024
- 2024FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAs8 Jan 2024
- 2024Fine-tuning and Utilization Methods of Domain-specific LLMs1 Jan 2024
- 2025A Study on the MCP x A2A Framework for Enhancing Interoperability of LLM-based Autonomous Agentscited by 8
- 2024Dynamic Multi-Agent Orchestration and Retrieval for Multi-Source Question-Answer Systems using Large Language Modelscited by 3
- 2024LLM-R: A Framework for Domain-Adaptive Maintenance Scheme Generation Combining Hierarchical Agents and RAGcited by 1
- 2024Contrato360 2.0: A Document and Database-Driven Question-Answer System using Large Language Models and Agentscited by 1
- 2025Modeling User-System Behavior for Training-free Building of Private Domain Conversational Agentscited by 0
- 2025Modeling User-System Behavior for Training-free Building of Private Domain Conversational Agents13 Nov 2025
- 2025A Study on the MCP x A2A Framework for Enhancing Interoperability of LLM-based Autonomous Agents2 Jun 2025
- 2024Dynamic Multi-Agent Orchestration and Retrieval for Multi-Source Question-Answer Systems using Large Language Models23 Dec 2024
- 2024Contrato360 2.0: A Document and Database-Driven Question-Answer System using Large Language Models and Agents23 Dec 2024
- 2024LLM-R: A Framework for Domain-Adaptive Maintenance Scheme Generation Combining Hierarchical Agents and RAG7 Nov 2024
- 2024A Study on the Implementation Method of an Agent-Based Advanced RAG System Using Graphcited by 8
- 2026HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answeringcited by 3
- 2025Data Quality Challenges in Retrieval-Augmented Generationcited by 1
- 2025Open-Source Retrieval Augmented Generation Framework for Retrieving Accurate Medication Insights from Formularies for African Healthcare Workerscited by 0
- 2026HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answering28 May 2026
- 2025Data Quality Challenges in Retrieval-Augmented Generation1 Oct 2025
- 2025Open-Source Retrieval Augmented Generation Framework for Retrieving Accurate Medication Insights from Formularies for African Healthcare Workers28 Jan 2025
- 2024A Study on the Implementation Method of an Agent-Based Advanced RAG System Using Graph29 Jul 2024
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Surveycited by 128
- 2024Fine-tuning and Utilization Methods of Domain-specific LLMscited by 36
- 2024Fine Tuning LLM for Enterprise: Practical Guidelines and Recommendationscited by 28
- 2025Evaluating LLM Metrics Through Real-World Capabilitiescited by 18
- 2024Leveraging Logical Rules in Knowledge Editing: A Cherry on the Topcited by 12
- 2026MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documentscited by 6
- 2025E2E Process Automation Leveraging Generative AI and IDP-Based Automation Agent: A Case Study on Corporate Expense Processingcited by 5
- 2024SecGenAI: Enhancing Security of Cloud-based Generative AI Applications within Australian Critical Technologies of National Interestcited by 2
- 2025A Study on the Framework for Evaluating the Ethics and Trustworthiness of Generative AIcited by 2
- 2024The future of document indexing: GPT and Donut revolutionize table of content processingcited by 1
- 2025Dr. GPT Will See You Now, but Should It? Exploring the Benefits and Harms of Large Language Models in Medical Diagnosis using Crowdsourced Clinical Casescited by 1
- 2026Predictive Prototyping: Evaluating Design Concepts with ChatGPTcited by 1
12 most cited of 15 All 15 (JSON)
- 2026MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documents14 Apr 2026
- 2026Predictive Prototyping: Evaluating Design Concepts with ChatGPT18 Jan 2026
- 2025A Study on the Framework for Evaluating the Ethics and Trustworthiness of Generative AI30 Aug 2025
- 2025LLM Chatbot-Creation Approaches28 Aug 2025
- 2025Dr. GPT Will See You Now, but Should It? Exploring the Benefits and Harms of Large Language Models in Medical Diagnosis using Crowdsourced Clinical Cases13 Jun 2025
- 2025E2E Process Automation Leveraging Generative AI and IDP-Based Automation Agent: A Case Study on Corporate Expense Processing27 May 2025
- 2025Evaluating LLM Metrics Through Real-World Capabilities13 May 2025
- 2025Accodemy: AI Powered Code Learning Platform to Assist Novice Programmers in Overcoming the Fear of Coding9 Mar 2025
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Survey9 Jul 2024
- 2024EventChat: Implementation and user-centric evaluation of a large language model-driven conversational recommender system for exploring leisure events in an SME context5 Jul 2024
- 2024SecGenAI: Enhancing Security of Cloud-based Generative AI Applications within Australian Critical Technologies of National Interest1 Jul 2024
- 2024Leveraging Logical Rules in Knowledge Editing: A Cherry on the Top24 May 2024
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Developing Retrieval Augmented Generation (RAG) based LLM Systems from PDFs: An Experience Report
- 2024Deploying Large Language Models With Retrieval Augmented Generation
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Survey
- 2025Retrieval-Augmented Generation in Industry: An Interview Study on Use Cases, Requirements, Challenges, and Evaluation
- 2024A Collaborative Multi-Agent Approach to Retrieval-Augmented Generation Across Diverse Data
- 2024The Power of Noise: Redefining Retrieval for RAG Systems
- 2024ERATTA: Extreme RAG for Table To Answers with Large Language Models