mlsanityData to 7 Oct 2026

DAR: Deontic Reasoning with Agentic Harnesses

arXiv 2606.05009 ↗First posted 3 Jun 2026cs.CL cs.AIcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Deontic reasoning is the task of answering questions by applying explicit rules and policies to case-specific facts, for example computing tax liability under a statute or determining the outcome of an immigration appeal. A key technical challenge for LLM-based deontic reasoning is that the relevant ruleset can be long and cross-referenced, so models may still fail to locate the rules needed for a particular reasoning step. We introduce Deontic Agentic Reasoning (DAR), an agentic reasoning setup in which the model interacts with the statutes on demand. We evaluate DAR under multiple harnesses on hard subsets of DeonticBench. Across these settings, we find that agentic harnesses can push the frontier on deontic reasoning tasks, but improvements are not uniform: weaker models often degrade on numerical tasks while consuming far more tokens.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 15 of its 27 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

15 of 27 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026DeonticBench: A Benchmark for Reasoning over Rules6 Apr

Other references · 14

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  3. 2025OpenAI GPT-5 System Cardcited by 910
  4. 2025Kimi K2: Open Agentic Intelligencecited by 523
  5. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  6. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  7. 2025Recursive Language Modelscited by 94
  8. 2025In-the-Flow Agentic System Optimization for Effective Planning and Tool Usecited by 67
  9. 2026CL-bench: A Benchmark for Context Learningcited by 46
  10. 2026Beyond Semantic Similarity: Rethinking Retrieval for Agentic Search via Direct Corpus Interactioncited by 33
  11. 2026OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesiscited by 32
  12. 2025JustLogic: A Comprehensive Benchmark for Evaluating Deductive Reasoning in Large Language Modelscited by 21
2 more
  1. 2026Is Grep All You Need? How Agent Harnesses Reshape Agentic Searchcited by 17
  2. 2026Conformal Thinking: Risk Control for Reasoning on a Compute Budgetcited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Benchmarking Defeasible Reasoning with Large Language Models -- Initial Experiments and Future Directions
  2. 2025Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Tools
  3. 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems
  4. 2026CHAL: Council of Hierarchical Agentic Language
  5. 2025LLM-based Agentic Reasoning Frameworks: A Survey from Methods to Scenarios
  6. 2026Clueing up LLMs with Tool-Augmented Deductive Reasoning
  7. 2025Agent-Based Detection and Resolution of Incompleteness and Ambiguity in Interactions with Large Language Models
  8. 2026The Reasoning Trap: An Information-Theoretic Bound on Closed-System Multi-Step LLM Reasoning