{"total":55,"rows":[{"id":"2503.21878","title":"Is Best-of-N the Best of Them? Coverage, Scaling, and Optimality in Inference-Time Alignment","created":"2025-03-27","cited_by_count":97,"area":"alignment"},{"id":"2509.06941","title":"Outcome-based Exploration for LLM Reasoning","created":"2025-09-08","cited_by_count":83,"area":"lr"},{"id":"2407.13399","title":"Correcting the Mythos of KL-Regularization: Direct Alignment without Overoptimization via Chi-Squared Preference Optimization","created":"2024-07-18","cited_by_count":78,"area":"alignment"},{"id":"2410.08847","title":"Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization","created":"2024-10-11","cited_by_count":67,"area":"alignment"},{"id":"2503.01067","title":"All Roads Lead to Likelihood: The Value of Reinforcement Learning in Fine-Tuning","created":"2025-03-03","cited_by_count":59,"area":"alignment"},{"id":"2602.02482","title":"Expanding the Capabilities of Reinforcement Learning via Text Feedback","created":"2026-02-02","cited_by_count":53,"area":"alignment"},{"id":"2503.11701","title":"A Survey of Direct Preference Optimization","created":"2025-03-12","cited_by_count":36,"area":"alignment"},{"id":"2411.04625","title":"Sharp Analysis for KL-Regularized Contextual Bandits and RLHF","created":"2024-11-07","cited_by_count":33,"area":"alignment"},{"id":"2604.13602","title":"Reward Hacking in the Era of Large Models: Mechanisms, Emergent Misalignment, Challenges","created":"2026-04-15","cited_by_count":33,"area":"alignment"},{"id":"2409.19605","title":"The Crucial Role of Samplers in Online Direct Preference Optimization","created":"2024-09-29","cited_by_count":27,"area":"alignment"},{"id":"2502.07460","title":"Logarithmic Regret for Online KL-Regularized Reinforcement Learning","created":"2025-02-11","cited_by_count":22,"area":"alignment"},{"id":"2602.01601","title":"Adaptive Rollout Allocation for Online Reinforcement Learning with Verifiable Rewards","created":"2026-02-02","cited_by_count":17,"area":null},{"id":"2503.08942","title":"Extragradient Preference Optimization (EGPO): Beyond Last-Iterate Convergence for Nash Learning from Human Feedback","created":"2025-03-11","cited_by_count":16,"area":"alignment"},{"id":"2505.05465","title":"ComPO: Preference Alignment via Comparison Oracles","created":"2025-05-08","cited_by_count":13,"area":"alignment"},{"id":"2502.01203","title":"KL-Regularized RLHF with Multiple Reference Models: Exact Solutions and Sample Complexity","created":"2025-02-03","cited_by_count":11,"area":"alignment"},{"id":"2510.24700","title":"Greedy Sampling Is Provably Efficient for RLHF","created":"2025-10-28","cited_by_count":11,"area":"alignment"},{"id":"2602.02495","title":"Reward-free Alignment for Conflicting Objectives","created":"2026-02-02","cited_by_count":11,"area":"alignment"},{"id":"2502.06051","title":"Towards a Sharp Analysis of Offline Policy Learning for $f$-Divergence-Regularized Contextual Bandits","created":"2025-02-09","cited_by_count":10,"area":"offlinerl"},{"id":"2505.19770","title":"Understanding the Performance Gap in Preference Learning: A Dichotomy of RLHF and DPO","created":"2025-05-26","cited_by_count":10,"area":"alignment"},{"id":"2502.16825","title":"Finding the Sweet Spot: Preference Data Construction for Scaling Preference Optimization","created":"2025-02-24","cited_by_count":9,"area":"alignment"},{"id":"2604.08706","title":"Efficient RL Training for LLMs with Experience Replay","created":"2026-04-09","cited_by_count":9,"area":null},{"id":"2505.15694","title":"A Unified Theoretical Analysis of Private and Robust Offline Alignment: from RLHF to DPO","created":"2025-05-21","cited_by_count":8,"area":"alignment"},{"id":"2505.19387","title":"Alignment of large language models with constrained learning","created":"2025-05-26","cited_by_count":8,"area":"alignment"},{"id":"2605.25343","title":"Toward Native Multimodal Modeling: A Roadmap","created":"2026-05-25","cited_by_count":7,"area":"wm"},{"id":"2505.02363","title":"SIMPLEMIX: Frustratingly Simple Mixing of Off- and On-policy Data in Language Model Preference Learning","created":"2025-05-05","cited_by_count":6,"area":"alignment"},{"id":"2506.07492","title":"Explicit Preference Optimization: No Need for an Implicit Reward Model","created":"2025-06-09","cited_by_count":6,"area":"alignment"},{"id":"2507.15507","title":"Off-Policy Corrected Reward Modeling for Reinforcement Learning from Human Feedback","created":"2025-07-21","cited_by_count":6,"area":"alignment"},{"id":"2601.08421","title":"Coverage Improvement and Fast Convergence of On-policy Preference Learning","created":"2026-01-13","cited_by_count":6,"area":"alignment"},{"id":"2601.16403","title":"Towards a Theoretical Understanding to the Generalization of RLHF","created":"2026-01-23","cited_by_count":6,"area":"alignment"},{"id":"2511.02833","title":"In Good GRACEs: Principled Teacher Selection for Knowledge Distillation","created":"2025-11-04","cited_by_count":5,"area":"distill"},{"id":"2512.20773","title":"DIAL: Direct Iterative Adversarial Learning for Realistic Multi-Turn Dialogue Simulation","created":"2025-12-23","cited_by_count":5,"area":null},{"id":"2601.12186","title":"Aletheia: What Makes RLVR For Code Verifiers Tick?","created":"2026-01-17","cited_by_count":5,"area":null},{"id":"2505.18407","title":"KL-regularization Itself is Differentially Private in Bandits and RLHF","created":"2025-05-23","cited_by_count":3,"area":"alignment"},{"id":"2505.21395","title":"Square$\\chi$PO: Differentially Private and Robust $\\chi^2$-Preference Optimization in Offline Direct Alignment","created":"2025-05-27","cited_by_count":3,"area":"alignment"},{"id":"2506.01523","title":"Beyond RLHF: A Unified Theoretical Framework of Alignment","created":"2025-06-02","cited_by_count":3,"area":"alignment"},{"id":"2510.20413","title":"Why DPO is a Misspecified Estimator and How to Fix It","created":"2025-10-23","cited_by_count":3,"area":"alignment"},{"id":"2603.22563","title":"Privacy-Preserving Reinforcement Learning from Human Feedback via Decoupled Reward Modeling","created":"2026-03-23","cited_by_count":3,"area":"alignment"},{"id":"2411.06568","title":"Meta-Learning Objectives for Preference Optimization","created":"2024-11-10","cited_by_count":2,"area":"alignment"},{"id":"2511.21056","title":"Bilevel Data Curation for LLM Fine-tuning: Offline Selection and Online Self-Refining Generation","created":"2025-11-26","cited_by_count":2,"area":null},{"id":"2506.08681","title":"Mitigating Reward Over-optimization in Direct Alignment Algorithms with Importance Sampling","created":"2025-06-10","cited_by_count":1,"area":"alignment"},{"id":"2604.12096","title":"LLM-HYPER: Generative CTR Modeling for Cold-Start Ad Personalization via LLM-Based Hypernetworks","created":"2026-04-13","cited_by_count":1,"area":null},{"id":"2605.18721","title":"General Preference Reinforcement Learning","created":"2026-05-18","cited_by_count":1,"area":"alignment"},{"id":"2606.01865","title":"Set-Supervised Diffusion Policy: Learning Action-Chunking Diffusion through Corrections","created":"2026-06-01","cited_by_count":1,"area":"diffusion"},{"id":"2507.21584","title":"TARS: MinMax Token-Adaptive Preference Strategy for Hallucination Reduction in MLLMs","created":"2025-07-29","cited_by_count":0,"area":"mllm"},{"id":"2509.24207","title":"Humanline: Online Alignment as Perceptual Loss","created":"2025-09-29","cited_by_count":0,"area":"lr"},{"id":"2510.05534","title":"Revisiting Self-Play Preference Optimization: On the Role of Prompt Difficulty","created":"2025-10-07","cited_by_count":0,"area":"alignment"},{"id":"2601.06108","title":"From RLHF to Direct Alignment: A Theoretical Unification of Preference Learning for Large Language Models","created":"2026-01-03","cited_by_count":0,"area":"alignment"},{"id":"2601.09236","title":"Reward Learning through Ranking Mean Squared Error","created":"2026-01-14","cited_by_count":0,"area":"alignment"},{"id":"2602.06239","title":"Provably avoiding over-optimization in Direct Preference Optimization without knowing the data distribution","created":"2026-02-05","cited_by_count":0,"area":"alignment"},{"id":"2602.19041","title":"Back to Blackwell: Closing the Loop on Intransitivity in Multi-Objective Preference Fine-Tuning","created":"2026-02-22","cited_by_count":0,"area":null},{"id":"2603.08145","title":"DARC: Disagreement-Aware Alignment via Risk-Constrained Decoding","created":"2026-03-09","cited_by_count":0,"area":"alignment"},{"id":"2605.04477","title":"Data-dependent Exploration for Online Reinforcement Learning from Human Feedback","created":"2026-05-06","cited_by_count":0,"area":"alignment"},{"id":"2605.21266","title":"How Much Online RL is Enough? Informative Rollouts for Offline Preference Optimization in RLVR","created":"2026-05-20","cited_by_count":0,"area":"lr"},{"id":"2606.01382","title":"Efficient Exploration for Iterative Nash Preference Optimization","created":"2026-05-31","cited_by_count":0,"area":"alignment"},{"id":"2609.19144","title":"A Zeroth-Order Paradigm for LLM Preference Alignment","created":"2026-09-16","cited_by_count":0,"area":"alignment"}],"next_cursor":null}