LOGIGEN: Logic-Driven Generation of Verifiable Agentic Tasks
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
The evolution of Large Language Models (LLMs) from static instruction-followers to autonomous agents necessitates operating within complex, stateful environments to achieve precise state-transition objectives. However, this paradigm is bottlenecked by data scarcity, as existing tool-centric reverse-synthesis pipelines fail to capture the rigorous logic of real-world applications. We introduce LOGIGEN, a logic-driven framework that synthesizes verifiable training data based on three core pillars: Hard-Compiled Policy Grounding, Logic-Driven Forward Synthesis, and Deterministic State Verification. Specifically, a Triple-Agent Orchestration is employed: the Architect compiles natural-language policy into database constraints to enforce hard rules; the Set Designer initializes boundary-adjacent states to trigger critical policy conflicts; and the Explorer searches this environment to discover causal solution paths. This framework yields a dataset of 20,000 complex tasks across 8 domains, where validity is strictly guaranteed by checking exact state equivalence. Furthermore, we propose a verification-based training protocol where Supervised Fine-Tuning (SFT) on verifiable trajectories establishes compliance with hard-compiled policy, while Reinforcement Learning (RL) guided by dense state-rewards refines long-horizon goal achievement. On τ2-Bench, LOGIGEN-32B(RL) achieves a 79.5% success rate, substantially outperforming the base model (40.7%). These results demonstrate that logic-driven synthesis combined with verification-based training effectively constructs the causally valid trajectories needed for next-generation agents.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 38 references that are in the map. First posted on arXiv 28 Feb 2026.
Builds on
28 of 38 references.
Closest ancestors · 5
Same direction, newest first
- 2026LongCat-Flash-Thinking-2601 Technical Report23 Jan
- 2025Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning23 Dec
- 2025Introducing LongCat-Flash-Thinking: A Technical Report23 Sep
- 2025Towards General Agentic Intelligence via Environment Scaling16 Sep
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
Other references · 23
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
- 2025ToolRL: Reward is All Tool Learning Needscited by 342
11 more
- 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 249
- 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 188
- 2025ACEBench: Who Wins the Match Point in Tool Usage?cited by 66
- 2025TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environmentscited by 61
- 2024Can You Trust LLM Judgments? Reliability of LLM-as-a-Judgecited by 52
- 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 46
- 2025MUA-RL: Multi-turn User-interacting Agent Reinforcement Learning for agentic tool usecited by 30
- 2025TrustJudge: Inconsistencies of LLM-as-a-Judge and How to Alleviate Themcited by 20
- 2025ToolRM: Outcome Reward Models for Tool-Calling Large Language Modelscited by 16
- 2026Unlocking Implicit Experience: Synthesizing Tool-Use Trajectories from Textcited by 13
- 2025Proof-of-Use: Mitigating Tool-Call Hacking in Deep Research Agentscited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Beyond Simply Environment Scaling: Designing Effective Environment Distributions for Multimodal Agent Learningcited by 2
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agentscited by 2
- 2026DynamicMCPBench: A Trace-Grounded, Effect-Scored Benchmark for LLM Agents over Live MCP Serverscited by 0
- 2026Agent Seer: Synthesizing Scenarios from Specification Understandingcited by 0
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents27 Aug 2026
- 2026Beyond Simply Environment Scaling: Designing Effective Environment Distributions for Multimodal Agent Learning4 Aug 2026
- 2026DynamicMCPBench: A Trace-Grounded, Effect-Scored Benchmark for LLM Agents over Live MCP Servers10 Jul 2026
- 2026Agent Seer: Synthesizing Scenarios from Specification Understanding24 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Verification as an Architectural Layer for LLM Agents: A V-Model Design, and a Pilot Study of Its Deterministic Core
- 2026From Natural Language Policies to Executable Obligations: A Verification Harness for Dependable In-Car LLM Agents
- 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoning
- 2026Stateful CARS: Exact Cross-History Reuse for Policy-Constrained LLM Agents
- 2025EvoSyn: Generalizable Evolutionary Data Synthesis for Verifiable Learning
- 2026Verify Before You Commit: Towards Faithful Reasoning in LLM Agents via Self-Auditing
- 2026Automating Formal Verification with Agent-Guided Tree Search
- 2026Formal Verification of Agentic Systems over Operational Data