mlsanityData to 14 Oct 2026

A Report on the llms evaluating the high school questions

arXiv 2505.00057 ↗First posted 30 Apr 2025cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

This report aims to evaluate the performance of large language models (LLMs) in solving high school science questions and to explore their potential applications in the educational field. With the rapid development of LLMs in the field of natural language processing, their application in education has attracted widespread attention. This study selected mathematics exam questions from the college entrance examinations (2019-2023) as evaluation data and utilized at least eight LLM APIs to provide answers. A comprehensive assessment was conducted based on metrics such as accuracy, response time, logical reasoning, and creativity. Through an in-depth analysis of the evaluation results, this report reveals the strengths and weaknesses of LLMs in handling high school science questions and discusses their implications for educational practice. The findings indicate that although LLMs perform excellently in certain aspects, there is still room for improvement in logical reasoning and creative problem-solving. This report provides an empirical foundation for further research and application of LLMs in the educational field and offers suggestions for improvement.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). First posted on arXiv 30 Apr 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Benchmark for LLM's Understanding of Middle School and High School Science Topics
  2. 2024Can LLMs Master Math? Investigating Large Language Models on Math Stack Exchange
  3. 2023Three Questions Concerning the Use of Large Language Models to Facilitate Mathematics Learning
  4. 2025Assessment of Evolving Large Language Models in Upper Secondary Mathematics
  5. 2025Analysis of instruction-based LLMs' capabilities to score and judge text-input problems in an academic setting
  6. 2024Evaluating Students' Open-ended Written Responses with LLMs: Using the RAG Framework for GPT-3.5, GPT-4, Claude-3, and Mistral-Large
  7. 2024LLMs Are Not Intelligent Thinkers: Introducing Mathematical Topic Tree Benchmark for Comprehensive Evaluation of LLMs
  8. 2025Large Language Models Don't Make Sense of Word Problems. A Scoping Review from a Mathematics Education Perspective