Minimal Witness Reinforcement Learning
On the map: Deep reinforcement learning methods → Interpretable and logic-guided RL also fits: Deep RL algorithms and representations
Abstract (arXiv)
``What are the irreducible conditions that are sufficient to produce an outcome?'' is one of the most common questions that recur across computation and science. Its answers, the minimal sufficient witnesses, are what we mean by explanations, mechanisms and reasons. These problems usually ask for multiple minimal witnesses, yet standard RL methods may reveal only one solution or redundant ones. We formalize this problem as minimal-witness identification and introduce Minimal-Witness Reinforcement Learning (MWRL). MWRL takes the union of the sets certified by successful proposals sampled from the policy and credits each proposal for the coverage the group union would lose without that proposal. This credit assignment, derived directly from the problem definition, unifies the demands for minimality and recovery of alternatives from a single black-box verifier bit. Under this principle, we derive a value iteration planner that recovers the entire family of witnesses and a policy gradient method that can scale to large language models. Across different experimental settings, MWRL recovers most minimal witnesses, while other methods return redundant supersets or a single witness. By making witness families learnable from verifier feedback, MWRL expands the scope of reinforcement learning beyond single-solution optimization. Our code is available at https://github.com/TSUITUENYUE/MWRL.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Interpretable and logic-guided RL, one of 15 directions in Deep reinforcement learning methods. Builds on 0 of its 63 references that are in the map. First posted on arXiv 5 Oct 2026.
Builds on
0 of 63 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Less Noise, More Voice: Reinforcement Learning for Reasoning via Instruction Purification
- 2025A Minimalist Approach to LLM Reasoning: from Rejection Sampling to Reinforce
- 2026Inverse Reinforcement Learning without an Optimal Demonstrator: A Feasible Reward Set Approach
- 2025Stabilizing Reinforcement Learning with LLMs: Formulation and Practices
- 2025Maximizing Confidence Alone Improves Reasoning
- 2026MInTRL: Off-policy Intervention can boost On-policy RL
- 2026Uniform-Correct Policy Optimization: Breaking RLVR's Indifference to Diversity
- 2022Efficient Reinforcement Learning from Demonstration Using Local Ensemble and Reparameterization with Split and Merge of Expert Policies