mlsanityData to 14 Oct 2026

Logical Structure as Knowledge: Enhancing LLM Reasoning via Structured Logical Knowledge Density Estimation

arXiv 2509.24836 ↗First posted 29 Sep 2025cs.AI cs.CL cs.LGcited by 1

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

The reasoning capabilities of Large Language Models (LLMs) are increasingly attributed to training data quality rather than mere parameter scaling. However, existing data-centric paradigms often equate quality with factuality or diversity and ignore the internal logical complexity of training samples. In this work, we propose that natural language harbors Structured Logical Knowledge manifested through entailment relationships and logical topologies. To quantify this, we introduce Structured Logical Knowledge Density (SLKD), a novel metric that measures logical information content by decomposing natural language into executable predicates and logical primitives. Our analysis reveals a significant logical disparity in current datasets where sparse logical signals predominate. Consequently, we propose a density aware re-cognizing optimization strategy that prioritizes high-density logical samples to enhance with the LLM's reasoning ability. Extensive experiments demonstrate that our approach enhances reasoning performance and generalization without increasing total data volume. These results, further validated within a reinforcement learning framework, suggest that elevating logical density is more critical than expanding data scale for realizing the full cognitive potential of LLMs. The released code is available in the Appendix C.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 20 of its 50 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

20 of 50 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024DeepSeek-V3 Technical Report27 Dec

Other references · 19

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2020Scaling Laws for Neural Language Modelscited by 6,586
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  5. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  6. 2023SemDeDup: Data-efficient learning at web-scale through semantic deduplicationcited by 303
  7. 2025LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters!cited by 132
  8. 2025A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyondcited by 132
  9. 2024Densing Law of LLMscited by 40
  10. 2025Ultra-FineWeb: Efficient Data Filtering and Verification for High-Quality LLM Training Datacited by 38
  11. 2024Strategic Data Ordering: Enhancing Large Language Model Performance through Curriculum Learningcited by 28
  12. 2025Data Whisperer: Efficient Data Selection for Task-Specific LLM Fine-Tuning via Few-Shot In-Context Learningcited by 20
7 more
  1. 2025Position: The Most Expensive Part of an LLM should be its Training Datacited by 16
  2. 2025Rethinking the Generation of High-Quality CoT Data from the Perspective of LLM-Adaptive Question Difficulty Gradingcited by 11
  3. 2025Unlocking the Potential of Difficulty Prior in RL-based Multimodal Reasoningcited by 7
  4. 2025AttentionInfluence: Adopting Attention Head Influence for Weak-to-Strong Pretraining Data Selectioncited by 5
  5. 2025Finding the Minimal Parameter Budget for Implicit Reasoning: A Data Complexity Driven Scaling Law for Language Modelscited by 3
  6. 2025RICo: Refined In-Context Contribution for Automatic Instruction-Tuning Data Selectioncited by 3
  7. 2025RAISE: Reinforced Adaptive Instruction Selection For Large Language Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Logical Reasoning in Large Language Models: A Survey
  2. 2024CLR-Fact: Evaluating the Complex Logical Reasoning Capability of Large Language Models over Factual Knowledge
  3. 2025Enhancing Large Language Models through Structured Reasoning
  4. 2025Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Study
  5. 2023Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyond
  6. 2023Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models
  7. 2026Discovering a Shared Logical Subspace: Steering LLM Logical Reasoning via Alignment of Natural-Language and Symbolic Views
  8. 2024LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models