Generation of Explanations for Logic Reasoning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
This thesis delves into a fortiori arguments in deductive reasoning, underscoring their relevance in various domains such as law, philosophy, and artificial intelligence. The research is centred on employing GPT-3.5-turbo to automate the analysis of these arguments, with a focus on understanding intricate reasoning processes, generating clear and coherent explanations, and creating novel arguments. The methodology encompasses a series of tasks including detailed reasoning, interpretation, and the augmentation of a fortiori arguments. It involves meticulously identifying these arguments in diverse contexts, differentiating comparative elements, and categorizing them based on their logical structure. Extensive experiments reveals the challenges encountered by GPT-3.5-turbo in accurately detecting and classifying a fortiori arguments. Nevertheless, the model demonstrates a performance that rivals specialized models, particularly in extracting key components and interpreting underlying properties. The integration of external information into the model's processing significantly elevates the quality of the generated explanations. Additionally, the model exhibits a noteworthy capability in augmenting arguments, thus contributing to the enrichment of the data set. Despite facing certain limitations, this thesis makes significant contributions to the fields of artificial intelligence and logical reasoning. It introduces novel methodologies, establishes a rigorous evaluation framework, and provides deep insights that set the stage for future advancements in automated logical reasoning. The findings and methodologies presented herein not only underscore the potential of AI in complex reasoning tasks but also highlight areas for future research and development.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 4 of its 66 references that are in the map. First posted on arXiv 22 Nov 2023.
Builds on
4 of 66 references.
Closest ancestors · 1
Same direction, newest first
Other references · 3
- 2023GPT-4 Technical Reportcited by 18,132
- 2023A Survey of Large Language Modelscited by 2,537
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2022MetaLogic: Logical Reasoning Explanations with Fine-Grained Structure
- 2023Can GPT-3 Perform Statutory Reasoning?
- 2024Aristotle: Mastering Logical Reasoning with A Logic-Complete Decompose-Search-Resolve Framework
- 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4
- 2024Inductive or Deductive? Rethinking the Fundamental Reasoning Abilities of LLMs
- 2023Can ChatGPT Defend its Belief in Truth? Evaluating LLM Reasoning via Debate
- 2024A Closer Look at Logical Reasoning with LLMs: The Choice of Tool Matters
- 2024LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models