Comparative Analysis of OpenAI GPT-4o and DeepSeek R1 for Scientific Text Categorization Using Prompt Engineering
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
This study examines how large language models categorize sentences from scientific papers using prompt engineering. We use two advanced web-based models, GPT-4o (by OpenAI) and DeepSeek R1, to classify sentences into predefined relationship categories. DeepSeek R1 has been tested on benchmark datasets in its technical report. However, its performance in scientific text categorization remains unexplored. To address this gap, we introduce a new evaluation method designed specifically for this task. We also compile a dataset of cleaned scientific papers from diverse domains. This dataset provides a platform for comparing the two models. Using this dataset, we analyze their effectiveness and consistency in categorization.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 1 of its 10 references that are in the map. First posted on arXiv 3 Mar 2025.
Builds on
1 of 10 references.
References · 1
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025Rethinking the Generation of High-Quality CoT Data from the Perspective of LLM-Adaptive Question Difficulty Gradingcited by 11
- 2025FishAI 2.0: Marine Fish Image Classification with Multi-modal Few-shot Learningcited by 0
- 2026Generating Hierarchical JSON Representations of Scientific Sentences Using LLMscited by 0
- 2026Generating Hierarchical JSON Representations of Scientific Sentences Using LLMs8 Mar 2026
- 2025FishAI 2.0: Marine Fish Image Classification with Multi-modal Few-shot Learning26 Sep 2025
- 2025Rethinking the Generation of High-Quality CoT Data from the Perspective of LLM-Adaptive Question Difficulty Grading16 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2025SciGPT: A Large Language Model for Scientific Literature Understanding and Knowledge Discovery
- 2025An evaluation of DeepSeek Models in Biomedical Natural Language Processing
- 2024DataAgent: Evaluating Large Language Models' Ability to Answer Zero-Shot, Natural Language Queries
- 2025The Empowerment of Science of Science by Large Language Models: New Tools and Methods
- 2023Text Classification via Large Language Models
- 2025SCI-IDEA: Context-Aware Scientific Ideation Using Token and Sentence Embeddings
- 2025Automated Knowledge Graph Construction using Large Language Models and Sentence Complexity Modelling
- 2025Evaluating the Performance of AI Text Detectors, Few-Shot and Chain-of-Thought Prompting Using DeepSeek Generated Text