APTER: Adaptive Post-Training with Expert-Grounded Rubrics
Not on the map. Why?
Abstract (arXiv)
As large language models enter professional domains, they must satisfy domain constraints, include critical evidence, and provide complete reasoning rather than merely produce fluent responses. Existing post-training methods often rely on holistic preferences or outcome-level verification, while recent rubric-based methods usually generate rubrics independently for each query. In specialized domains, such unconstrained rubrics may omit critical requirements and vary across samples, hindering the diagnosis and targeted repair of persistent capability deficiencies. We propose APTER (Adaptive Post-Training with Expert-Grounded Rubrics), a framework that integrates structured domain knowledge into fine-grained evaluation, optimization, and diagnosis for specialized complex reasoning. First, expert-grounded rubric construction starts from an expert criteria framework built by domain experts, where each criterion represents a stable professional capability. For each query, APTER selects relevant criteria and instantiates them into query-level rubrics linked to their source criteria, turning reusable expert criteria into executable query-level supervision without reference answers. Second, adaptive post-training uses rubric verdicts as both optimization and criterion-level diagnostic signals. Aggregating low-scoring verdicts by criterion ID reveals persistent deficiencies and triggers targeted supervised fine-tuning updates during reinforcement learning. Experiments on mathematical reasoning and medical question answering show consistent gains across both domains. Across three model generations, APTER improves the mathematics and medical averages over the corresponding base models by up to 15.86 and 8.04 points, respectively. Code and rubric datasets are available at https://github.com/AntDT-APTER/APTER.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 63 references that are in the map. First posted on arXiv 14 Aug 2026.
Builds on
37 of 63 references.
References · 37
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Let's Verify Step by Stepcited by 3,789
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
25 more
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
- 2023Reinforced Self-Training (ReST) for Language Modelingcited by 500
- 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 429
- 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 427
- 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 366
- 2025A Minimalist Approach to LLM Reasoning: from Rejection Sampling to Reinforcecited by 145
- 2025OpenRubrics: Towards Scalable Synthetic Rubric Generation for Reward Modeling and LLM Alignmentcited by 132
- 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cyclescited by 124
- 2025Reinforcement Learning with Rubric Anchorscited by 113
- 2025Learning What Reinforcement Learning Can't: Interleaved Online Fine-Tuning for Hardest Questionscited by 97
- 2026Rethinking Rubric Generation for Improving LLM Judge and Reward Modeling for Open-ended Taskscited by 62
- 2026RubricHub: A Comprehensive and Highly Discriminative Rubric Dataset via Automated Coarse-to-Fine Generationcited by 52
- 2025Reward and Guidance through Rubrics: Promoting Exploration to Improve Multi-Domain Reasoningcited by 21
- 2026Learning to Self-Verify Makes Language Models Better Reasonerscited by 21
- 2026Step-wise Rubric Rewards for LLM Reasoningcited by 14
- 2026AdaRubric: Task-Adaptive Rubrics for Reliable LLM Agent Evaluation and Reward Learningcited by 13
- 2026LiveMedBench: A Contamination-Free Medical Benchmark for LLMs with Automated Rubric Evaluationcited by 12
- 2026RubricRAG: Towards Interpretable and Reliable LLM Evaluation via Domain Knowledge Retrieval for Rubric Generationcited by 11
- 2026PAPO: Stabilizing Rubric Integration Training via Decoupled Advantage Normalizationcited by 11
- 2026Alternating Reinforcement Learning with Contextual Rubric Rewards: Beyond the Scalarization Strategycited by 6
- 2026AutoChecklist: Composable Pipelines for Checklist Generation and Scoring with LLM-as-a-Judgecited by 5
- 2026SpeechMedAssist: Efficiently and Effectively Adapting Speech Language Models for Medical Consultationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Direct Reasoning Optimization: Token-Level Reasoning Reflectivity Meets Rubric Gates for Unverifiable Tasks
- 2026GenRubric: Self-Evolving Rubric Generation for Scalable LLM Evaluation
- 2026Reliable to Expressive: A Curriculum for Rubric-Following Safety Judges
- 2026Post-Reasoning: Improving the Performance of Non-Thinking Models at No Cost
- 2026PRISM: Priority-aware Rubric Internalization via Structured Multimodal Data Synthesis
- 2026RASFT: Rollout-Adaptive Supervised Fine-Tuning for Reasoning
- 2026Feedback-to-Rubrics: Can We Learn Expert Criteria from Inline Comments?
- 2025Online Rubrics Elicitation from Pairwise Comparisons