ECPO: Evidence-Coupled Policy Optimization for Evidence-Certified Candidate Ranking
Not on the map. Why?
Abstract (arXiv)
Ranking systems used in decision-support settings should not only order candidates but also expose evidence that can be independently checked. We study evidence-certified candidate ranking: given an intent_id, a predefined plan skeleton, a window-local candidate roster, and text-derived candidate trajectories with span provenance, a system must output a Top-K list together with doc_id:span evidence certificates whose cited spans are sufficient to recover the decision. We instantiate this task on MAVEN-ERE and RAMS with fixed upstream extraction, window-local randomized candidate identifiers, skeleton-aligned trajectory supervision, hard negatives, and audit references. We introduce Evidence-Coupled Policy Optimization (ECPO), a listwise policy-optimization objective whose action is the joint object of ranking and evidence certificate. ECPO first learns an interpretable trajectory reward from skeleton alignment, argument consistency, and optional graph features; it then optimizes a constrained policy with three coupled rewards: listwise ranking utility, span-level certificate validity, and an evidence-cycle reward computed by a label-free deterministic verifier that reconstructs candidate support from claim-stripped cited spans. This reframes the goal from maximizing ordinary NDCG alone to maximizing CertNDCG and decision-evidence coupling. The evaluation compares ECPO against zero-shot, SFT, and GRPO policies, RM-only scoring with deterministic evidence attachment, grammar/JSON-constrained decoding, validator retry, best-of-N RM selection, and post-hoc evidence rationalization under closed-roster, predicted-roster, and hybrid-roster settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 21 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
7 of 21 references.
References · 7
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2016Investigative Simulation: Towards Utilizing Graph Pattern Matching for Investigative Searchcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Evidence-Augmented Policy Optimization with Reward Co-Evolution for Long-Context Reasoning
- 2026Structure-aware Relative Policy Optimization for Ranking
- 2026Contextual Information Policy Optimization for Search Agents
- 2026VERPO: Verified Evidence Regularized Policy Optimization
- 2026BELIEFRAG: Making Adaptive RAG State-Aware under Evolving Evidence
- 2026Efficient Best-of-N policy evaluation for inference-time alignment
- 2026Benchmarking and Training Reward Models for Cross-Source Evidence Grounding in Search Agents
- 2026SEEDS: Preview-Guided Evidence Admission for Search Agents