mlsanityData to 7 Oct 2026

LLeMpower: Understanding Disparities in the Control and Access of Large Language Models

arXiv 2404.09356 ↗First posted 14 Apr 2024cs.CY cs.AI cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are a powerful technology that augment human skill to create new opportunities, akin to the development of steam engines and the internet. However, LLMs come with a high cost. They require significant computing resources and energy to train and serve. Inequity in their control and access has led to concentration of ownership and power to a small collection of corporations. In our study, we collect training and inference requirements for various LLMs. We then analyze the economic strengths of nations and organizations in the context of developing and serving these models. Additionally, we also look at whether individuals around the world can access and use this emerging technology. We compare and contrast these groups to show that these technologies are monopolized by a surprisingly few entities. We conclude with a qualitative study on the ethical implications of our findings and discuss future directions towards equity in LLM access.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 40 of its 64 references that are in the map. First posted on arXiv 14 Apr 2024.

Builds on

40 of 64 references.

References · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  7. 2020Scaling Laws for Neural Language Modelscited by 6,411
  8. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  9. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  10. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  11. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  12. 2022Training Compute-Optimal Large Language Modelscited by 2,927
28 more
  1. 2023A Survey of Large Language Modelscited by 2,537
  2. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  3. 2020Knowledge Distillation: A Surveycited by 1,578
  4. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  5. 2023BloombergGPT: A Large Language Model for Financecited by 923
  6. 2023LLM-Pruner: On the Structural Pruning of Large Language Modelscited by 643
  7. 2023A Comprehensive Overview of Large Language Modelscited by 639
  8. 2023Bias and Fairness in Large Language Models: A Surveycited by 626
  9. 2019Green AIcited by 620
  10. 2024Large Language Models: A Surveycited by 506
  11. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
  12. 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
  13. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
  14. 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 257
  15. 2023Atom: Low-bit Quantization for Efficient and Accurate LLM Servingcited by 255
  16. 2023MathPrompter: Mathematical Reasoning using Large Language Modelscited by 236
  17. 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 156
  18. 2023CodePlan: Repository-level Coding using LLMs and Planningcited by 139
  19. 2023Large Language Models for Robotics: A Surveycited by 132
  20. 2023Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecturecited by 119
  21. 2020The Cost of Training NLP Models: A Concise Overviewcited by 97
  22. 2023Document-Level Machine Translation with Large Language Modelscited by 90
  23. 202314 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathoncited by 85
  24. 2024DebugBench: Evaluating Debugging Capability of Large Language Modelscited by 74
  25. 2023LLMCarbon: Modeling the end-to-end Carbon Footprint of Large Language Modelscited by 71
  26. 2023Fairness in Language Models Beyond English: Gaps and Challengescited by 16
  27. 2023Harnessing the Power of LLMs: Evaluating Human-AI Text Co-Creation through the Lens of News Headline Generationcited by 14
  28. 2024LLMs for Coding and Robotics Educationcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 2.

5 papers.