mlsanityData to 14 Oct 2026

Structuring Reasoning for Complex Rules Beyond Flat Representations

arXiv 2510.05134 ↗First posted 1 Oct 2025cs.AIcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language models (LLMs) face significant challenges when processing complex rule systems, as they typically treat interdependent rules as unstructured textual data rather than as logically organized frameworks. This limitation results in reasoning divergence, where models often overlook critical rule dependencies essential for accurate interpretation. Although existing approaches such as Chain-of-Thought (CoT) reasoning have shown promise, they lack systematic methodologies for structured rule processing and are particularly susceptible to error propagation through sequential reasoning chains. To address these limitations, we propose the Dynamic Adjudication Template (DAT), a novel framework inspired by expert human reasoning processes. DAT structures the inference mechanism into three methodical stages: qualitative analysis, evidence gathering, and adjudication. During the qualitative analysis phase, the model comprehensively evaluates the contextual landscape. The subsequent evidence gathering phase involves the targeted extraction of pertinent information based on predefined template elements ([placeholder]), followed by systematic verification against applicable rules. Finally, in the adjudication phase, the model synthesizes these validated components to formulate a comprehensive judgment. Empirical results demonstrate that DAT consistently outperforms conventional CoT approaches in complex rule-based tasks. Notably, DAT enables smaller language models to match, and in some cases exceed, the performance of significantly larger LLMs, highlighting its efficiency and effectiveness in managing intricate rule systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 16 of its 41 references that are in the map. First posted on arXiv 1 Oct 2025.

Builds on

16 of 41 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools18 Jun

Other references · 15

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  6. 2023A Survey of Large Language Modelscited by 2,576
  7. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
  8. 2023BloombergGPT: A Large Language Model for Financecited by 939
  9. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
  10. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 681
  11. 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
  12. 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
3 more
  1. 2024A Comprehensive Survey and Guide to Multimodal Large Language Models in Vision-Language Taskscited by 27
  2. 2024Investigating LLM Applications in E-Commercecited by 7
  3. 2025EVADE-Bench: Multimodal Benchmark for Evaluating and Enhancing Evasive Content Detectioncited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning
  2. 2025Benchmarking Multi-Step Legal Reasoning and Analyzing Chain-of-Thought Effects in Large Language Models
  3. 2026Compliance vs. Sensibility: On the Reasoning Controllability in Large Language Models
  4. 2025From Thinking to Output: Chain-of-Thought and Text Generation Characteristics in Reasoning Language Models
  5. 2025The CoT Encyclopedia: Analyzing, Predicting, and Controlling how a Reasoning Model will Think
  6. 2023Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance
  7. 2024Chain of Logic: Rule-Based Reasoning with Large Language Models
  8. 2025Deductive Logic in Language Models: Horizontal vs Vertical Reasoning