QuantumQA: Enhancing Scientific Reasoning via Physics-Consistent Dataset and Verification-Aware Reinforcement Learning
On the map: LLM reasoning → Reinforcement learning for reasoning
Abstract (arXiv)
Large language models (LLMs) show strong capabilities in general reasoning but typically lack reliability in scientific domains like quantum mechanics, which demand strict adherence to physical constraints. This limitation arises from the scarcity of verifiable training resources and the inadequacy of coarse feedback signals in standard alignment paradigms. To address the data challenge, we introduce QuantumQA, a large-scale dataset constructed via a task-adaptive strategy and a hybrid verification protocol that combines deterministic solvers with semantic auditing to guarantee scientific rigor. Building on this foundation, we propose the verification-aware reward model (VRM) tailored for Reinforcement Learning with Verifiable Rewards (RLVR), which employs an adaptive reward fusion (ARF) mechanism to dynamically integrate deterministic signals from a scientific execution suite (SES) with multidimensional semantic evaluations for precise supervision. Experimental results demonstrate that our method consistently outperforms baselines and general-purpose preference models. Notably, our optimized 8B model achieves performance competitive with proprietary models, validating that incorporating verifiable, rule-based feedback into the reinforcement learning loop offers a parameter-efficient alternative to pure scaling.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 23 of its 73 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
23 of 73 references.
Closest ancestors · 4
Same direction, newest first
- 2025DreamPRM-Code: Function-as-Step Process Reward Model with Label Correction for LLM Coding17 Dec
- 2025Skywork-Reward-V2: Scaling Preference Data Curation via Human-AI Synergy2 Jul
- 2022Solving math word problems with process- and outcome-based feedback25 Nov
- 2017Proximal Policy Optimization Algorithms20 Jul
Other references · 19
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
- 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIcited by 227
- 2025QuanBench: Benchmarking Quantum Code Generation with Large Language Modelscited by 10
- 2025QAgent: An LLM-based Multi-Agent System for Autonomous OpenQASM programmingcited by 9
7 more
- 2024Reinforcement Learning for Variational Quantum Circuits Designcited by 8
- 2024Hybrid LLM/Rule-based Approaches to Business Insights Generation from Structured Datacited by 7
- 2025Information-Theoretic Reward Modeling for Stable RLHF: Detecting and Mitigating Reward Hackingcited by 5
- 2024A Survey on Testing and Analysis of Quantum Softwarecited by 4
- 2024Scalable quantum dynamics compilation via quantum machine learningcited by 3
- 2025QuantumBench: A Benchmark for Quantum Problem Solvingcited by 3
- 2025Learning Natural Language Constraints for Safe Reinforcement Learning of Language Agentscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025VerifyBench: A Systematic Benchmark for Evaluating Reasoning Verifiers Across Domains
- 2025PEPS: Quantum-Inspired Reinforcement Learning for Coherent Reasoning Traces in LLMs
- 2026Reinforcement Learning with Verifiable Physics: Post-training LLMs with Continuous Rewards
- 2026Resource-Efficient Reinforcement for Reasoning Large Language Models via Dynamic One-Shot Policy Refinement
- 2026SUPERNOVA: Eliciting General Reasoning in LLMs with Reinforcement Learning on Natural Instructions
- 2026BeamPERL: Parameter-Efficient RL with Verifiable Rewards Specializes Compact LLMs for Structured Beam Mechanics Reasoning
- 2025ConfClip: Confidence-Weighted and Clipped Reward for Reinforcement Learning in LLMs
- 2025Trust, But Verify: A Self-Verification Approach to Reinforcement Learning with Verifiable Rewards