mlsanityData to 7 Oct 2026

The Chase Is the Curriculum, the Capture Anchors the Credit: Pursuit-Evasion Self-Play for Zero-Data LLM Reasoning

arXiv 2608.21871 ↗First posted 22 Aug 2026cs.CL cs.LGcited by 0

On the map: LLM reasoning → Reinforcement learning for reasoning

also in 1 more
Abstract (arXiv)

Reinforcement learning with verifiable rewards has become the dominant recipe for improving large language model reasoning, yet it presumes large human-curated task collections. Zero-data self-play removes this dependency, but existing methods vet learnability only by probing candidates and rejecting post hoc, never learning where along an environment's difficulty axis to place a task, and credit the solver with sparse terminal rewards alone. We recast zero-data self-play as a pursuit-evasion game: in LURE, an LLM evader positions tasks along each environment's difficulty axis to stay one step ahead of a planner-executor pursuer that hunts it down through verifiable interaction. The evader is trained on a capture-frontier reward that peaks when the solver captures it on exactly half of its rollouts, turning barely catchable into a learned positioning strategy rather than a hand-tuned rejection band. The pursuer earns capture-anchored dense process credit, in which monotone verifier progress is group-normalized jointly with the terminal capture under a round-anchored KL that keeps the co-evolution stable. Across three verifiable reasoning environments and three backbone families, LURE outperforms advanced baselines under unified/specialist settings, while the unified model attains stronger aggregate OOD zero-shot accuracy than all trained baselines across nine held-out benchmarks from three task families.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 34 references that are in the map. First posted on arXiv 22 Aug 2026.

Builds on

17 of 34 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025What Can You Do When You Have Zero Rewards During RL?4 Oct
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning22 Jan
  3. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Training22 Nov
  4. 2017Proximal Policy Optimization Algorithms20 Jul

Other references · 13

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  4. 2024Qwen2.5 Technical Reportcited by 4,713
  5. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  6. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  7. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  8. 2017Automatic Goal Generation for Reinforcement Learning Agentscited by 252
  9. 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 242
  10. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
  11. 2017Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Playcited by 139
  12. 2026Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMscited by 115
1 more
  1. 2025SPIRAL: Self-Play on Zero-Sum Games Incentivizes Reasoning via Multi-Agent Multi-Turn Reinforcement Learningcited by 89

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Data
  2. 2025Towards Understanding Self-play for LLM Reasoning
  3. 2025OpenSIR: Open-Ended Self-Improving Reasoner
  4. 2026WIST: Web-Grounded Iterative Self-Play Tree for Domain-Targeted Reasoning Improvement
  5. 2026Survive or Collapse: The Asymmetric Roles of Data Gating and Reward Grounding in Self-Play RL
  6. 2026From RLVR to RLSVR: Task Transformation Induces Self-Verifiable Rewards for Open-Ended LLM Self-Improvement
  7. 2025Language Self-Play For Data-Free Training
  8. 2025DISCOVER: Automated Curricula for Sparse-Reward Reinforcement Learning