mlsanityData to 14 Oct 2026

DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

arXiv 2401.14196 ↗First posted 25 Jan 2024cs.SE cs.CL cs.LGcited by 1,181

Not on the map. Why?

Cited by 232 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The rapid development of large language models has revolutionized code intelligence in software development. However, the predominance of closed-source models has restricted extensive research and development. To address this, we introduce the DeepSeek-Coder series, a range of open-source code models with sizes from 1.3B to 33B, trained from scratch on 2 trillion tokens. These models are pre-trained on a high-quality project-level code corpus and employ a fill-in-the-blank task with a 16K window to enhance code generation and infilling. Our extensive evaluations demonstrate that DeepSeek-Coder not only achieves state-of-the-art performance among open-source code models across multiple benchmarks but also surpasses existing closed-source models like Codex and GPT-3.5. Furthermore, DeepSeek-Coder models are under a permissive license that allows for both research and unrestricted commercial use.

Key facts. Cited by 1,181 papers in the map (data through 14 Oct 2026). Builds on 29 of its 43 references that are in the map. First posted on arXiv 25 Jan 2024.

Builds on

29 of 43 references.

References · 29

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  7. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  8. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  9. 2021Program Synthesis with Large Language Modelscited by 3,637
  10. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  11. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  12. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
17 more
  1. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
  2. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 906
  3. 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
  4. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
  5. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
  6. 2021Deduplicating Training Data Makes Language Models Bettercited by 714
  7. 2022PAL: Program-aided Language Modelscited by 652
  8. 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 498
  9. 2022DS-1000: A Natural and Reliable Benchmark for Data Science Code Generationcited by 452
  10. 2022The Stack: 3 TB of permissively licensed source codecited by 359
  11. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
  12. 2021A Diverse Corpus for Evaluating and Developing English Math Word Problem Solverscited by 318
  13. 2022Reducing Activation Recomputation in Large Transformer Modelscited by 302
  14. 2023CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-Xcited by 300
  15. 2022Efficient Training of Language Models to Fill in the Middlecited by 255
  16. 2023CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completioncited by 183
  17. 2023SantaCoder: don't reach for the stars!cited by 170

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 367; 2025: 513; 2026: 301.

1,181 papers.

Sort:

By area:

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  4. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  5. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  6. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  7. 2024DeepSeek-V3 Technical Reportcited by 811
  8. 2024A Survey on Large Language Models for Code Generationcited by 658
  9. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
  10. 2024Large Language Models: A Surveycited by 525
  11. 2025Process Reinforcement through Implicit Rewardscited by 504
  12. 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 438
38 more
  1. 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 421
  2. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
  3. 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 331
  4. 2024LoRA Learns Less and Forgets Lesscited by 328
  5. 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 263
  6. 2024OpenCodeInterpreter: Integrating Code Generation with Execution and Refinementcited by 247
  7. 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
  8. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 198
  9. 2024Advancing LLM Reasoning Generalists with Preference Treescited by 192
  10. 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 178
  11. 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 178
  12. 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solvingcited by 177
  13. 2024Building and better understanding vision-language models: insights and future directionscited by 173
  14. 2024CHESS: Contextual Harnessing for Efficient SQL Synthesiscited by 169
  15. 2025The Unreasonable Effectiveness of Entropy Minimization in LLM Reasoningcited by 166
  16. 2024Large Language Model-Brained GUI Agents: A Surveycited by 162
  17. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
  18. 2024CodeGemma: Open Code Models Based on Gemmacited by 150
  19. 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 147
  20. 2024How to Train Long-Context Language Models (Effectively)cited by 146
  21. 2024MAmmoTH2: Scaling Instructions from the Webcited by 145
  22. 2024Rho-1: Not All Tokens Are What You Needcited by 133
  23. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 131
  24. 2024Observational Scaling Laws and the Predictability of Language Model Performancecited by 130
  25. 2024OpenCoder: The Open Cookbook for Top-Tier Code Large Language Modelscited by 130
  26. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
  27. 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 128
  28. 2025Right Question is Already Half the Answer: Fully Unsupervised LLM Reasoning Incentivizationcited by 128
  29. 2024Language Models Learn to Mislead Humans via RLHFcited by 124
  30. 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 122
  31. 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environmentscited by 120
  32. 2024InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoningcited by 119
  33. 2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Codingcited by 119
  34. 2024Large Language Model Unlearning via Embedding-Corrupted Promptscited by 116
  35. 2024Twin-Merging: Dynamic Integration of Modular Expertise in Model Mergingcited by 116
  36. 2025CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratingscited by 115
  37. 2025OpenCodeReasoning: Advancing Data Distillation for Competitive Codingcited by 113
  38. 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 111

50 most cited of 1,181 All 1,181 (JSON)