General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Contemporary large language models (LLMs) have demonstrated remarkable reasoning capabilities, particularly in specialized domains like mathematics and physics. However, their ability to generalize these reasoning skills to more general and broader contexts--often termed general reasoning--remains under-explored. Unlike domain-specific reasoning, general reasoning relies less on expert knowledge but still presents formidable reasoning challenges, such as complex constraints, nested logical branches, and semantic interference. To address this gap, we introduce General365, a benchmark specifically designed to assess general reasoning in LLMs. By restricting background knowledge to a K-12 level, General365 explicitly decouples reasoning from specialized expertise. The benchmark comprises 365 seed problems and 1,095 variant problems across eight categories, ensuring both high difficulty and diversity. Evaluations across 26 leading LLMs reveal that even the top-performing model achieves only 62.8% accuracy, in stark contrast to the near-perfect performances of LLMs in math and physics benchmarks. These results suggest that the reasoning abilities of current LLMs are heavily domain-dependent, leaving significant room for improvement in broader applications. We envision General365 as a catalyst for advancing LLM reasoning beyond domain-specific tasks toward robust, general-purpose real-world scenarios. Code, Dataset, and Leaderboard: https://general365.github.io
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 30 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
18 of 30 references.
Closest ancestors · 2
Same direction, newest first
- 2025AMO-Bench: Large Language Models Still Struggle in High School Math Competitions30 Oct
- 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI7 Nov
Other references · 16
- 2025Qwen3 Technical Reportcited by 8,195
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
- 2025Humanity's Last Examcited by 467
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
- 2024ARC Prize 2024: Technical Reportcited by 103
- 2024KOR-Bench: Benchmarking Language Models on Knowledge-Orthogonal Reasoning Taskscited by 67
- 2025SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplinescited by 67
- 2025LongCat-Flash Technical Reportcited by 54
- 2026LongCat-Flash-Thinking-2601 Technical Reportcited by 32
4 more
- 2025Hunyuan-TurboS: Advancing Large Language Models through Mamba-Transformer Synergy and Adaptive Chain-of-Thoughtcited by 28
- 2025ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problemscited by 17
- 2025PhysUniBench: A Multi-Modal Physics Reasoning Benchmark at Undergraduate Levelcited by 14
- 2026Perfect score on IPhO 2025 theory by Gemini agentcited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026From Proprietary to Open-Source: Bridging the Distribution Gap via Multi-Agent Protocol Distillation in Agentic Searchcited by 4
- 2026Can Multimodal Large Language Models Understand OCT?cited by 3
- 2026Beyond Relevance-Centric Retrieval: Rubric-Oriented Document Set Selection and Rankingcited by 2
- 2026DecoEvo: Score-Decoupled Co-Evolution of Solver and Rubric-Generator Skills in Text Spacecited by 2
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligencecited by 2
- 2026ClawTrack: Towards Trace-Level Evaluation and Improvement of Real-World Autonomous Agentscited by 1
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence31 Aug 2026
- 2026ClawTrack: Towards Trace-Level Evaluation and Improvement of Real-World Autonomous Agents30 Jul 2026
- 2026DecoEvo: Score-Decoupled Co-Evolution of Solver and Rubric-Generator Skills in Text Space28 Jul 2026
- 2026From Proprietary to Open-Source: Bridging the Distribution Gap via Multi-Agent Protocol Distillation in Agentic Search27 Jul 2026
- 2026Beyond Relevance-Centric Retrieval: Rubric-Oriented Document Set Selection and Ranking22 Jul 2026
- 2026Can Multimodal Large Language Models Understand OCT?18 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025Large Language Models and Mathematical Reasoning Failures
- 2025Evaluating Mathematical Reasoning Across Large Language Models: A Fine-Grained Approach
- 2025Mathematical Reasoning in Large Language Models: Assessing Logical and Arithmetic Errors across Wide Numerical Ranges
- 2026Mathematical Reasoning in Large Language Models: Benchmarks, Architectures, Evaluation, and Open Challenges
- 2023Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Models
- 2025ReasoningWeekly: A General Knowledge and Verbal Reasoning Challenge for Large Language Models
- 2025Putnam-AXIOM: A Functional and Static Benchmark for Measuring Higher Level Mathematical Reasoning in LLMs
- 2025From General Reasoning to Domain Expertise: Uncovering the Limits of Generalization in Large Language Models