mlsanityData to 13 Oct 2026

ChatGPT vs. DeepSeek: A Comparative Study on AI-Based Code Generation

arXiv 2502.18467 ↗First posted 30 Jan 2025cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Background: AI-powered code generation, fueled by Large Language Models (LLMs), is revolutionizing software development. Models like OpenAI's Codex and GPT-4, alongside DeepSeek, leverage vast code and natural language datasets. However, ensuring code quality, correctness, and managing complex tasks remains challenging, necessitating thorough evaluation. Methodology: This research compares ChatGPT (version o1) and DeepSeek (version R1) for Python code generation using online judge coding challenges. It evaluates correctness (online judge verdicts, up to three attempts), code quality (Pylint/Flake8), and efficiency (execution time/memory usage). Results: DeepSeek demonstrated higher correctness, particularly on algorithmic tasks, often achieving 'Accepted' on the first attempt. ChatGPT sometimes requires multiple attempts or failures. ChatGPT encountered fewer issues, used comparable or slightly less memory, consumed less execution times and wrote fewer lines of code. Conclusion: DeepSeek exhibited superior correctness in Python code generation, often requiring fewer attempts, suggesting an advantage in algorithmic problem-solving. Both models showed almost similar efficiency in execution time and memory use. Finally, this research provides insights for developers choosing AI coding assistants and informs future AI-driven software development research.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 8 of its 12 references that are in the map. First posted on arXiv 30 Jan 2025.

Builds on

8 of 12 references.

References · 8

  1. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,362
  2. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 726
  3. 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 328
  4. 2023Refining ChatGPT-Generated Code: Characterizing and Mitigating Code Quality Issuescited by 79
  5. 2023Evaluating the Code Quality of AI-Assisted Code Generation Tools: An Empirical Study on GitHub Copilot, Amazon CodeWhisperer, and ChatGPTcited by 71
  6. 2023Extending the Frontier of ChatGPT: Code Generation and Debuggingcited by 9
  7. 2024ChatGPT Code Detection: Techniques for Uncovering the Source of Codecited by 6
  8. 2024Programming with AI: Evaluating ChatGPT, Gemini, AlphaCode, and GitHub Copilot for Programmerscited by 5

Built on by

Not cited yet.