mlsanityData to 14 Oct 2026

From GPT-3 to GPT-5: Mapping their capabilities, scope, limitations, and consequences

arXiv 2604.10332 ↗First posted 11 Apr 2026cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

We present the progress of the GPT family from GPT-3 through GPT-3.5, GPT-4, GPT-4 Turbo, GPT-4o, GPT-4.1, and the GPT-5 family. Our work is comparative rather than merely historical. We investigates how the family evolved in technical framing, user interaction, modality, deployment architecture, and governance viewpoint. The work focuses on five recurring themes: technical progression, capability changes, deployment shifts, persistent limitations, and downstream consequences. In term of research design, we consider official technical reports, system cards, API and model documentation, product announcements, release notes, and peer-reviewed secondary studies. A primary assertion is that later GPT generations should not be interpreted only as larger or more accurate language models. Instead, the family evolves from a scaled few-shot text predictor into a set of aligned, multimodal, tool-oriented, long-context, and increasingly workflow-integrated systems. This development complicates simple model-to-model comparison because product routing, tool access, safety tuning, and interface design become part of the effective system. Across generations, several limitations remain unchanged: hallucination, prompt sensitivity, benchmark fragility, uneven behavior across domains and populations, and incomplete public transparency about architecture and training. However, the family has evolved software development, educational practice, information work, interface design, and discussions of frontier-model governance. We infer that the transition from GPT-3 to GPT-5 is best understood not only as an improvement in model capability, but also as a broader reformulation of what a deployable AI system is, how it is evaluated, and where responsibility should be located when such systems are used at scale.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 35 of its 67 references that are in the map. First posted on arXiv 11 Apr 2026.

Builds on

35 of 67 references.

References · 35

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  6. 2024GPT-4o System Cardcited by 4,588
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  8. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
  9. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  10. 2023Using an LLM to Help With Code Understandingcited by 228
  11. 2024Large Language Models Meet NLP: A Surveycited by 103
  12. 2025Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contaminationcited by 82
23 more
  1. 2023Continual Instruction Tuning for Large Multimodal Modelscited by 49
  2. 2025Beyond GPT-5: Making LLMs Cheaper and Better via Performance-Efficiency Optimized Routingcited by 34
  3. 2024Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiencycited by 31
  4. 2024Bias Unveiled: Investigating Social Bias in LLM-Generated Codecited by 25
  5. 2025Efficient Reasoning for Large Reasoning Language Models via Certainty-Guided Reflection Suppressioncited by 24
  6. 2025Graph Generative Pre-trained Transformercited by 17
  7. 2024LLM Targeted Underperformance Disproportionately Impacts Vulnerable Userscited by 15
  8. 2025A Human-AI Comparative Analysis of Prompt Sensitivity in LLM-Based Relevance Judgmentcited by 15
  9. 2025Evaluating Long-Context Reasoning in LLM-Based WebAgentscited by 15
  10. 2025GPT-4.1 Sets the Standard in Automated Experiment Design Using Novel Python Librariescited by 8
  11. 2025Mind Your Tone: Investigating How Prompt Politeness Affects LLM Accuracy (short paper)cited by 8
  12. 2024HumanEval on Latest GPT Models -- 2024cited by 7
  13. 2025No Free Lunch in Language Model Bias Mitigation? Targeted Bias Reduction Can Exacerbate Unmitigated LLM Biasescited by 7
  14. 2025Capabilities of GPT-5 across critical domains: Is it the next breakthrough?cited by 6
  15. 2026Institutional AI: A Governance Framework for Distributional AGI Safetycited by 6
  16. 2026When Benchmarks Leak: Inference-Time Decontamination for LLMscited by 5
  17. 2026The Path Ahead for Agentic AI: Challenges and Opportunitiescited by 4
  18. 2026HiMu: Hierarchical Multimodal Frame Selection for Long Video Question Answeringcited by 4
  19. 2026Tracing the Data Trail: A Survey of Data Provenance, Transparency and Traceability in LLMscited by 3
  20. 2025An Analysis of LLM Fine-Tuning and Few-Shot Learning for Flaky Test Detection and Classificationcited by 2
  21. 2026LLM is Not All You Need: A Systematic Evaluation of ML vs. Foundation Models for text and image based Medical Classificationcited by 2
  22. 2025Instruction-Following Evaluation of Large Vision-Language Modelscited by 1
  23. 2026The LLM Mirage: Economic Interests and the Subversion of Weaponization Controlscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.