mlsanityData to 7 Oct 2026

LOGIGEN: Logic-Driven Generation of Verifiable Agentic Tasks

arXiv 2603.00540 ↗First posted 28 Feb 2026cs.AIcited by 5

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

The evolution of Large Language Models (LLMs) from static instruction-followers to autonomous agents necessitates operating within complex, stateful environments to achieve precise state-transition objectives. However, this paradigm is bottlenecked by data scarcity, as existing tool-centric reverse-synthesis pipelines fail to capture the rigorous logic of real-world applications. We introduce LOGIGEN, a logic-driven framework that synthesizes verifiable training data based on three core pillars: Hard-Compiled Policy Grounding, Logic-Driven Forward Synthesis, and Deterministic State Verification. Specifically, a Triple-Agent Orchestration is employed: the Architect compiles natural-language policy into database constraints to enforce hard rules; the Set Designer initializes boundary-adjacent states to trigger critical policy conflicts; and the Explorer searches this environment to discover causal solution paths. This framework yields a dataset of 20,000 complex tasks across 8 domains, where validity is strictly guaranteed by checking exact state equivalence. Furthermore, we propose a verification-based training protocol where Supervised Fine-Tuning (SFT) on verifiable trajectories establishes compliance with hard-compiled policy, while Reinforcement Learning (RL) guided by dense state-rewards refines long-horizon goal achievement. On τ2-Bench, LOGIGEN-32B(RL) achieves a 79.5% success rate, substantially outperforming the base model (40.7%). These results demonstrate that logic-driven synthesis combined with verification-based training effectively constructs the causally valid trajectories needed for next-generation agents.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 38 references that are in the map. First posted on arXiv 28 Feb 2026.

Builds on

28 of 38 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026LongCat-Flash-Thinking-2601 Technical Report23 Jan
  2. 2025Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning23 Dec
  3. 2025Introducing LongCat-Flash-Thinking: A Technical Report23 Sep
  4. 2025Towards General Agentic Intelligence via Environment Scaling16 Sep
  5. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun

Other references · 23

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  5. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  6. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  7. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  8. 2024A Survey on LLM-as-a-Judgecited by 1,384
  9. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  10. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  11. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  12. 2025ToolRL: Reward is All Tool Learning Needscited by 342
11 more
  1. 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 249
  2. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 188
  3. 2025ACEBench: Who Wins the Match Point in Tool Usage?cited by 66
  4. 2025TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environmentscited by 61
  5. 2024Can You Trust LLM Judgments? Reliability of LLM-as-a-Judgecited by 52
  6. 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 46
  7. 2025MUA-RL: Multi-turn User-interacting Agent Reinforcement Learning for agentic tool usecited by 30
  8. 2025TrustJudge: Inconsistencies of LLM-as-a-Judge and How to Alleviate Themcited by 20
  9. 2025ToolRM: Outcome Reward Models for Tool-Calling Large Language Modelscited by 16
  10. 2026Unlocking Implicit Experience: Synthesizing Tool-Use Trajectories from Textcited by 13
  11. 2025Proof-of-Use: Mitigating Tool-Call Hacking in Deep Research Agentscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Verification as an Architectural Layer for LLM Agents: A V-Model Design, and a Pilot Study of Its Deterministic Core
  2. 2026From Natural Language Policies to Executable Obligations: A Verification Harness for Dependable In-Car LLM Agents
  3. 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoning
  4. 2026Stateful CARS: Exact Cross-History Reuse for Policy-Constrained LLM Agents
  5. 2025EvoSyn: Generalizable Evolutionary Data Synthesis for Verifiable Learning
  6. 2026Verify Before You Commit: Towards Faithful Reasoning in LLM Agents via Self-Auditing
  7. 2026Automating Formal Verification with Agent-Guided Tree Search
  8. 2026Formal Verification of Agentic Systems over Operational Data