mlsanityData to 7 Oct 2026

Large Language Models for Education and Research: An Empirical and User Survey-based Analysis

arXiv 2512.08057 ↗First posted 8 Dec 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Pretrained Large Language Models (LLMs) have achieved remarkable success across diverse domains, with education and research emerging as particularly impactful areas. Among current state-of-the-art LLMs, ChatGPT and DeepSeek exhibit strong capabilities in mathematics, science, medicine, literature, and programming. In this study, we present a comprehensive evaluation of these two LLMs through background technology analysis, empirical experiments, and a real-world user survey. The evaluation explores trade-offs among model accuracy, computational efficiency, and user experience in educational and research affairs. We benchmarked these LLMs performance in text generation, programming, and specialized problem-solving. Experimental results show that ChatGPT excels in general language understanding and text generation, while DeepSeek demonstrates superior performance in programming tasks due to its efficiency-focused design. Moreover, both models deliver medically accurate diagnostic outputs and effectively solve complex mathematical problems. Complementing these quantitative findings, a survey of students, educators, and researchers highlights the practical benefits and limitations of these models, offering deeper insights into their role in advancing education and research.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 8 Dec 2025.

Builds on

17 of 36 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  4. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  5. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
  6. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
  7. 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 325
  8. 2023Mathematical Capabilities of ChatGPTcited by 263
  9. 2023AugGPT: Leveraging ChatGPT for Text Data Augmentationcited by 128
  10. 2023Exploring the Limits of ChatGPT for Query or Aspect-based Text Summarizationcited by 122
  11. 2023Refining ChatGPT-Generated Code: Characterizing and Mitigating Code Quality Issuescited by 78
  12. 2023ChatGPT and Software Testing Education: Promises & Perilscited by 40
5 more
  1. 2023ChatGPT as a Math Questioner? Evaluating ChatGPT on Generating Pre-university Math Questionscited by 8
  2. 2025Evaluating Mathematical Reasoning Across Large Language Models: A Fine-Grained Approachcited by 8
  3. 2024RoBERTa-BiLSTM: A Context-Aware Hybrid Model for Sentiment Analysiscited by 7
  4. 2024Programming with AI: Evaluating ChatGPT, Gemini, AlphaCode, and GitHub Copilot for Programmerscited by 5
  5. 2025A Method for the Architecture of a Medical Vertical Large Language Model Based on Deepseek R1cited by 1

Built on by

Not cited yet.