mlsanityData to 7 Oct 2026

FSLI: An Interpretable Formal Semantic System for One-Dimensional Ordering Inference

arXiv 2502.08415 ↗First posted 12 Feb 2025cs.CL cs.LOcited by 0

Not on the map. Why?

Abstract (arXiv)

We develop a system for solving logical deduction one-dimensional ordering problems by transforming natural language premises and candidate statements into first-order logic. Building on Heim and Kratzer's syntax-based compositional semantic rules which utilizes lambda calculus, we develop a semantic parsing algorithm with abstract types, templated rules, and a dynamic component for interpreting entities within a context constructed from the input. The resulting logical forms are executed via constraint logic programming to determine which candidate statements can be logically deduced from the premises. The symbolic system, the Formal Semantic Logic Inferer (FSLI), provides a formally grounded, linguistically driven system for natural language logical deduction. We evaluate it on both synthetic and derived logical deduction problems. FSLI achieves 100% accuracy on BIG-bench's logical deduction task and 88% on a syntactically simplified subset of AR-LSAT outperforming an LLM baseline, o1-preview. While current research in natural language reasoning emphasizes neural language models, FSLI highlights the potential of principled, interpretable systems for symbolic logical deduction in NLP.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 43 references that are in the map. First posted on arXiv 12 Feb 2025.

Builds on

13 of 43 references.

References · 13

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  3. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
  4. 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 533
  5. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 379
  6. 2022On the Paradox of Learning to Reason from Datacited by 93
  7. 2024A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasonerscited by 73
  8. 2023Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyondcited by 65
  9. 2024Puzzle Solving using Reasoning of Large Language Models: A Surveycited by 44
  10. 2021From LSAT: The Progress and Challenges of Complex Reasoningcited by 43
  11. 2024LOGIC-LM++: Multi-Step Refinement for Symbolic Formulationscited by 14
  12. 2017Towards Universal Semantic Taggingcited by 12
1 more
  1. 2025Investigating the Robustness of Deductive Reasoning with Large Language Modelscited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Divide and Translate: Compositional First-Order Logic Translation and Verification for Complex Logical Reasoning
  2. 2022FOLIO: Natural Language Reasoning with First-Order Logic
  3. 2024Scaling Synthetic Logical Reasoning Datasets with Context-Sensitive Declarative Grammars
  4. 2024Autoformalizing Natural Language to First-Order Logic: A Case Study in Logical Fallacy Detection
  5. 2023Learning Deductive Reasoning from Synthetic Corpus based on Formal Logic
  6. 2025Large Language Models Meet Symbolic Provers for Logical Reasoning Evaluation
  7. 2026Structured Abductive-Deductive-Inductive Reasoning for LLMs via Algebraic Invariants
  8. 2026Logic-Parametric Neuro-Symbolic NLI: Controlling Logical Formalisms for Verifiable LLM Reasoning