mlsanityData to 14 Oct 2026

Challenges and Applications of Large Language Models: A Comparison of GPT and DeepSeek family of models

arXiv 2508.21377 ↗First posted 29 Aug 2025cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are transforming AI across industries, but their development and deployment remain complex. This survey reviews 16 key challenges in building and using LLMs and examines how these challenges are addressed by two state-of-the-art models with unique approaches: OpenAI's closed source GPT-4o (May 2024 update) and DeepSeek-V3-0324 (March 2025), a large open source Mixture-of-Experts model. Through this comparison, we showcase the trade-offs between closed source models (robust safety, fine-tuned reliability) and open source models (efficiency, adaptability). We also explore LLM applications across different domains (from chatbots and coding tools to healthcare and education), highlighting which model attributes are best suited for each use case. This article aims to guide AI researchers, developers, and decision-makers in understanding current LLM capabilities, limitations, and best practices.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 14 references that are in the map. First posted on arXiv 29 Aug 2025.

Builds on

12 of 14 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  7. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  8. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  9. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,103
  10. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  11. 2023A Watermark for Large Language Modelscited by 725
  12. 2023Challenges and Applications of Large Language Modelscited by 254

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
  2. 2024ChatGPT Alternative Solutions: Large Language Models Survey
  3. 2025A Review of DeepSeek Models' Key Innovative Techniques
  4. 2025Comparison of Large Language Models for Deployment Requirements
  5. 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?
  6. 2023GPT-Fathom: Benchmarking Large Language Models to Decipher the Evolutionary Path towards GPT-4 and Beyond
  7. 2025Reasoning Beyond Limits: Advances and Open Problems for LLMs
  8. 2023A Comprehensive Overview of Large Language Models