No Size Fits All: The Perils and Pitfalls of Leveraging LLMs Vary with Company Size
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are playing a pivotal role in deploying strategic use cases across a range of organizations, from large pan-continental companies to emerging startups. The issues and challenges involved in the successful utilization of LLMs can vary significantly depending on the size of the organization. It is important to study and discuss these pertinent issues of LLM adaptation with a focus on the scale of the industrial concerns and brainstorm possible solutions and prospective directions. Such a study has not been prominently featured in the current research literature. In this study, we adopt a threefold strategy: first, we conduct a case study with industry practitioners to formulate the key research questions; second, we examine existing industrial publications to address these questions; and finally, we provide a practical guide for industries to utilize LLMs more efficiently. We release the GitHubfootnoteurlhttps://github.com/vinayakcse/IndustrialLLMsPapers repository with the most recent papers in the field.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 47 of its 98 references that are in the map. First posted on arXiv 21 Jul 2024.
Builds on
47 of 98 references.
References · 47
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
- 2016Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Modelscited by 299
- 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 296
- 2022Reasoning with Language Model Prompting: A Surveycited by 251
- 2023Large Language Models in Finance: A Surveycited by 223
- 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 196
- 2023Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoningcited by 177
- 2022Multi-lingual Evaluation of Code Generation Modelscited by 158
- 2023CodePlan: Repository-level Coding using LLMs and Planningcited by 139
35 more
- 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 90
- 2023Bootstrap Your Own Skills: Learning to Solve New Tasks with Large Language Model Guidancecited by 85
- 2023Automatic Root Cause Analysis via Large Language Models for Cloud Incidentscited by 82
- 2023Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferencescited by 66
- 2019Sticking to the Facts: Confident Decoding for Faithful Data-to-Text Generationcited by 62
- 2023Detecting Edit Failures In Large Language Models: An Improved Specificity Benchmarkcited by 62
- 2023Are You Copying My Model? Protecting the Copyright of Large Language Models for EaaS via Backdoor Watermarkcited by 61
- 2023Are ChatGPT and GPT-4 General-Purpose Solvers for Financial Text Analytics? A Study on Several Typical Taskscited by 59
- 2023On the steerability of large language models toward data-driven personascited by 53
- 2023Tabular Representation, Noisy Operators, and Impacts on Table Structure Understanding Tasks in LLMscited by 49
- 2023ChatGPT Empowered Long-Step Robot Control in Various Environments: A Case Applicationcited by 48
- 2023Empower Large Language Model to Perform Better on Industrial Domain-Specific Question Answeringcited by 41
- 2023Understanding In-Context Learning via Supportive Pretraining Datacited by 41
- 2023Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutorscited by 38
- 2023Building Real-World Meeting Summarization Systems using Large Language Models: A Practical Perspectivecited by 34
- 2023DisasterResponseGPT: Large Language Models for Accelerated Plan of Action Development in Disaster Response Scenarioscited by 33
- 2024An Empirical Evaluation of LLMs for Solving Offensive Security Challengescited by 33
- 2023Exploring the Boundaries of GPT-4 in Radiologycited by 31
- 2024FlowMind: Automatic Workflow Generation with LLMscited by 30
- 2023Large Language Models of Code Fail at Completing Code with Potential Bugscited by 28
- 2022What do LLMs Know about Financial Markets? A Case Study on Reddit Market Sentiment Analysiscited by 27
- 2023KoSBi: A Dataset for Mitigating Social Bias Risks Towards Safer Large Language Model Applicationcited by 24
- 2024Properties and Challenges of LLM-Generated Explanationscited by 24
- 2023Beyond Summarization: Designing AI Support for Real-World Expository Writing Taskscited by 20
- 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Surveycited by 18
- 2023Assess and Summarize: Improve Outage Understanding with Large Language Modelscited by 17
- 2023GrACE: Generation using Associated Code Editscited by 16
- 2024LimGen: Probing the LLMs for Generating Suggestive Limitations of Research Paperscited by 16
- 2023A Static Evaluation of Code Completion by Large Language Modelscited by 14
- 2023DELPHI: Data for Evaluating LLMs' Performance in Handling Controversial Issuescited by 11
- 2023InstructPTS: Instruction-Tuning LLMs for Product Title Summarizationcited by 9
- 2023Fabricator: An Open Source Toolkit for Generating Labeled Training Data with Teacher LLMscited by 7
- 2023Matching Pairs: Attributing Fine-Tuned Models to their Pre-Trained Large Language Modelscited by 6
- 2023Finspector: A Human-Centered Visual Inspection Tool for Exploring and Comparing Biases among Foundation Modelscited by 5
- 2023H2O Open Ecosystem for State-of-the-art Large Language Modelscited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.