mlsanityData to 7 Oct 2026

INTEGRALBENCH: Benchmarking LLMs with Definite Integral Problems

arXiv 2507.21130 ↗First posted 22 Jul 2025cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

We present INTEGRALBENCH, a focused benchmark designed to evaluate Large Language Model (LLM) performance on definite integral problems. INTEGRALBENCH provides both symbolic and numerical ground truth solutions with manual difficulty annotations. Our evaluation of nine state-of-the-art LLMs reveals significant performance gaps and strong correlations between problem difficulty and model accuracy, establishing baseline metrics for this challenging domain. INTEGRALBENCH aims to advance automated mathematical reasoning by providing a rigorous evaluation framework specifically tailored for definite integral computation.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 19 of its 27 references that are in the map. First posted on arXiv 22 Jul 2025.

Builds on

19 of 27 references.

References · 19

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  7. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
  8. 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
  9. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
  10. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  11. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
  12. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 483
7 more
  1. 2023Llemma: An Open Language Model For Mathematicscited by 385
  2. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
  3. 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 236
  4. 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
  5. 2023GeomVerse: A Systematic Evaluation of Large Models for Geometric Reasoningcited by 107
  6. 2024U-MATH: A University-Level Benchmark for Evaluating Mathematical Skills in LLMscited by 24
  7. 2024Enabling Discriminative Reasoning in LLMs for Legal Judgment Predictioncited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

  1. 2026Towards Self-Robust LLMs: Intrinsic Prompt Noise Resistance via CoIPOcited by 5
  2. 2025Tag-Enriched Multi-Attention with Large Language Models for Cross-Domain Sequential Recommendationcited by 0
  3. 2026Evaluating SageMath-Augmented LLM Agents for Computational and Experimental Mathematicscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Models
  2. 2025Do LLMs Overthink Basic Math Reasoning? Benchmarking the Accuracy-Efficiency Tradeoff in Language Models
  3. 2025HARDMath2: A Benchmark for Applied Mathematics Built by Students as Part of a Graduate Class
  4. 2025FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models
  5. 2024FineMath: A Fine-Grained Mathematical Evaluation Benchmark for Chinese Large Language Models
  6. 2025BrokenMath: A Benchmark for Sycophancy in Theorem Proving with LLMs
  7. 2026Beyond the Answer Key: Robustness Evaluation of Large Language Models for Step-Level Mathematical Verification
  8. 2025IMProofBench: Benchmarking AI on Research-Level Mathematical Proof Generation