{"total":131,"rows":[{"id":"2502.17420","title":"The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independence","created":"2025-02-24","cited_by_count":115,"area":"alignment"},{"id":"2503.21878","title":"Is Best-of-N the Best of Them? Coverage, Scaling, and Optimality in Inference-Time Alignment","created":"2025-03-27","cited_by_count":97,"area":"alignment"},{"id":"2409.18169","title":"Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Survey","created":"2024-09-26","cited_by_count":90,"area":"alignment"},{"id":"2410.14872","title":"How to Evaluate Reward Models for RLHF","created":"2024-10-18","cited_by_count":88,"area":"alignment"},{"id":"2504.12501","title":"Reinforcement Learning from Human Feedback","created":"2025-04-16","cited_by_count":58,"area":"alignment"},{"id":"2504.09466","title":"AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak Defender","created":"2025-04-13","cited_by_count":38,"area":"alignment"},{"id":"2502.09650","title":"Principled Data Selection for Alignment: The Hidden Risks of Difficult Examples","created":"2025-02-11","cited_by_count":37,"area":"alignment"},{"id":"2503.15484","title":"Value Profiles for Encoding Human Variation","created":"2025-03-19","cited_by_count":29,"area":"alignment"},{"id":"2410.02197","title":"Beyond Bradley-Terry Models: A General Preference Model for Language Model Alignment","created":"2024-10-03","cited_by_count":27,"area":"alignment"},{"id":"2410.13116","title":"Learning to Summarize from LLM-generated Feedback","created":"2024-10-17","cited_by_count":24,"area":"alignment"},{"id":"2503.02846","title":"Mask-DPO: Generalizable Fine-grained Factuality Alignment of LLMs","created":"2025-03-04","cited_by_count":24,"area":"alignment"},{"id":"2411.00062","title":"Scalable Reinforcement Post-Training Beyond Static Human Prompts: Evolving Alignment via Asymmetric Self-Play","created":"2024-10-31","cited_by_count":21,"area":"alignment"},{"id":"2410.04203","title":"RainbowPO: A Unified Framework for Combining Improvements in Preference Optimization","created":"2024-10-05","cited_by_count":19,"area":"alignment"},{"id":"2503.00231","title":"Jawaher: A Multidialectal Dataset of Arabic Proverbs for LLM Benchmarking","created":"2025-02-28","cited_by_count":18,"area":"alignment"},{"id":"2505.16869","title":"MPO: Multilingual Safety Alignment via Reward Gap Optimization","created":"2025-05-22","cited_by_count":18,"area":"alignment"},{"id":"2501.19266","title":"Jackpot! Alignment as a Maximal Lottery","created":"2025-01-31","cited_by_count":17,"area":"alignment"},{"id":"2502.16182","title":"IPO: Your Language Model is Secretly a Preference Classifier","created":"2025-02-22","cited_by_count":17,"area":"alignment"},{"id":"2503.02832","title":"AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation","created":"2025-03-04","cited_by_count":17,"area":"alignment"},{"id":"2506.17252","title":"Adaptive Batch-Wise Sample Scheduling for Direct Preference Optimization","created":"2025-06-08","cited_by_count":17,"area":"alignment"},{"id":"2503.08942","title":"Extragradient Preference Optimization (EGPO): Beyond Last-Iterate Convergence for Nash Learning from Human Feedback","created":"2025-03-11","cited_by_count":16,"area":"alignment"},{"id":"2504.05154","title":"CARE: Multilingual Human Preference Learning for Cultural Awareness","created":"2025-04-07","cited_by_count":15,"area":"alignment"},{"id":"2510.04309","title":"Activation Steering with a Feedback Controller","created":"2025-10-05","cited_by_count":15,"area":"alignment"},{"id":"2502.14289","title":"Drift: Decoding-time Personalized Alignments with Implicit User Preferences","created":"2025-02-20","cited_by_count":13,"area":"alignment"},{"id":"2410.02205","title":"Aligning with Logic: Measuring, Evaluating and Improving Logical Preference Consistency in Large Language Models","created":"2024-10-03","cited_by_count":12,"area":"alignment"},{"id":"2410.09412","title":"FB-Bench: A Fine-Grained Multi-Task Benchmark for Evaluating LLMs' Responsiveness to Human Feedback","created":"2024-10-12","cited_by_count":11,"area":"alignment"},{"id":"2411.05986","title":"Fine-Grained Reward Optimization for Machine Translation using Error Severity Mappings","created":"2024-11-08","cited_by_count":11,"area":"alignment"},{"id":"2411.12843","title":"Reward Modeling with Ordinal Feedback: Wisdom of the Crowd","created":"2024-11-19","cited_by_count":11,"area":"alignment"},{"id":"2502.14340","title":"Earlier Tokens Contribute More: Learning Direct Preference Optimization From Temporal Decay Perspective","created":"2025-02-20","cited_by_count":11,"area":"alignment"},{"id":"2503.01864","title":"Larger or Smaller Reward Margins to Select Preferences for Alignment?","created":"2025-02-25","cited_by_count":11,"area":"alignment"},{"id":"2505.17196","title":"Shape it Up! Restoring LLM Safety during Finetuning","created":"2025-05-22","cited_by_count":11,"area":"alignment"},{"id":"2410.08067","title":"Reward-Augmented Data Enhances Direct Preference Alignment of LLMs","created":"2024-10-10","cited_by_count":10,"area":"alignment"},{"id":"2410.13828","title":"A Common Pitfall of Margin-based Language Model Alignment: Gradient Entanglement","created":"2024-10-17","cited_by_count":10,"area":"alignment"},{"id":"2411.09947","title":"LoRA-LiteE: A Computationally Efficient Framework for Chatbot Preference-Tuning","created":"2024-11-15","cited_by_count":10,"area":"alignment"},{"id":"2502.19731","title":"Preference Learning Unlocks LLMs' Psycho-Counseling Skills","created":"2025-02-27","cited_by_count":10,"area":"alignment"},{"id":"2503.01658","title":"CoPL: Collaborative Preference Learning for Personalizing LLMs","created":"2025-03-03","cited_by_count":10,"area":"alignment"},{"id":"2506.07326","title":"Reward Model Interpretability via Optimal and Pessimal Tokens","created":"2025-06-08","cited_by_count":10,"area":"alignment"},{"id":"2504.13630","title":"Remedy: Learning Machine Translation Evaluation from Human Preferences with Reward Modeling","created":"2025-04-18","cited_by_count":9,"area":"alignment"},{"id":"2504.15477","title":"In-context Ranking Preference Optimization","created":"2025-04-21","cited_by_count":9,"area":"alignment"},{"id":"2506.06636","title":"SafeLawBench: Towards Safe Alignment of Large Language Models","created":"2025-06-07","cited_by_count":9,"area":"alignment"},{"id":"2506.10054","title":"Uni-DPO: A Unified Paradigm for Dynamic Preference Optimization of LLMs","created":"2025-06-11","cited_by_count":9,"area":"alignment"},{"id":"2506.16655","title":"Arch-Router: Aligning LLM Routing with Human Preferences","created":"2025-06-19","cited_by_count":9,"area":"alignment"},{"id":"2503.17338","title":"Capturing Individual Human Preferences with Reward Features","created":"2025-03-21","cited_by_count":8,"area":"alignment"},{"id":"2502.03699","title":"LLM Alignment as Retriever Optimization: An Information Retrieval Perspective","created":"2025-02-06","cited_by_count":7,"area":"alignment"},{"id":"2503.02989","title":"Effectively Steer LLM To Follow Preference via Building Confident Directions","created":"2025-03-04","cited_by_count":7,"area":"alignment"},{"id":"2506.06404","title":"Unintended Harms of Value-Aligned LLMs: Psychological and Empirical Insights","created":"2025-06-06","cited_by_count":7,"area":"alignment"},{"id":"2508.04149","title":"Difficulty-Based Preference Data Selection by DPO Implicit Reward Gap","created":"2025-08-06","cited_by_count":7,"area":"alignment"},{"id":"2509.23102","title":"Multiplayer Nash Preference Optimization","created":"2025-09-27","cited_by_count":7,"area":"alignment"},{"id":"2604.08524","title":"What Drives Representation Steering? A Mechanistic Case Study on Steering Refusal","created":"2026-04-09","cited_by_count":7,"area":"alignment"},{"id":"2410.04834","title":"As Simple as Fine-tuning: LLM Alignment via Bidirectional Negative Feedback Loss","created":"2024-10-07","cited_by_count":6,"area":"alignment"},{"id":"2502.00657","title":"LLM Safety Alignment is Divergence Estimation in Disguise","created":"2025-02-02","cited_by_count":6,"area":"alignment"},{"id":"2502.13946","title":"Why Safeguarded Ships Run Aground? Aligned Large Language Models' Safety Mechanisms Tend to Be Anchored in The Template Region","created":"2025-02-19","cited_by_count":6,"area":"alignment"},{"id":"2503.04222","title":"FuseChat-3.0: Preference Optimization Meets Heterogeneous Model Fusion","created":"2025-03-06","cited_by_count":6,"area":"alignment"},{"id":"2506.00166","title":"Disentangled Safety Adapters Enable Efficient Guardrails and Flexible Inference-Time Alignment","created":"2025-05-30","cited_by_count":6,"area":"alignment"},{"id":"2507.00665","title":"SAFER: Probing Safety in Reward Models with Sparse Autoencoder","created":"2025-07-01","cited_by_count":6,"area":"alignment"},{"id":"2507.07981","title":"Why is Your Language Model a Poor Implicit Reward Model?","created":"2025-07-10","cited_by_count":6,"area":"alignment"},{"id":"2510.04320","title":"Read the Scene, Not the Script: Outcome-Aware Safety for LLMs","created":"2025-10-05","cited_by_count":6,"area":"alignment"},{"id":"2411.06424","title":"How Does DPO Reduce Toxicity? A Mechanistic Neuron-Level Analysis","created":"2024-11-10","cited_by_count":5,"area":"alignment"},{"id":"2502.13177","title":"KL Penalty Control via Perturbation for Direct Preference Optimization","created":"2025-02-18","cited_by_count":5,"area":"alignment"},{"id":"2506.14574","title":"TGDPO: Harnessing Token-Level Reward Guidance for Enhancing Direct Preference Optimization","created":"2025-06-17","cited_by_count":5,"area":"alignment"},{"id":"2507.16329","title":"DREAM: Scalable Red Teaming for Text-to-Image Generative Systems via Distribution Modeling","created":"2025-07-22","cited_by_count":5,"area":"alignment"},{"id":"2512.23260","title":"Interpretable Safety Alignment via SAE-Constructed Low-Rank Subspace Adaptation","created":"2025-12-29","cited_by_count":5,"area":"alignment"},{"id":"2503.15880","title":"InCo-DPO: Balancing Distribution Shift and Data Quality for Enhanced Preference Optimization","created":"2025-03-20","cited_by_count":4,"area":"alignment"},{"id":"2505.03059","title":"Improving Model Alignment Through Collective Intelligence of Open-Source LLMS","created":"2025-05-05","cited_by_count":4,"area":"alignment"},{"id":"2508.18142","title":"Mirroring Users: Towards Building Preference-aligned User Simulator with User Feedback in Recommendation","created":"2025-08-25","cited_by_count":4,"area":"alignment"},{"id":"2602.11523","title":"Unifying Stable Optimization and Reference Regularization in RLHF","created":"2026-02-12","cited_by_count":4,"area":"alignment"},{"id":"2503.23777","title":"CONGRAD:Conflicting Gradient Filtering for Multilingual Preference Alignment","created":"2025-03-31","cited_by_count":3,"area":"alignment"},{"id":"2506.14157","title":"DCRM: A Heuristic to Measure Response Pair Quality in Preference Optimization","created":"2025-06-17","cited_by_count":3,"area":"alignment"},{"id":"2508.16982","title":"Decoding Alignment: A Critical Survey of LLM Development Initiatives through Value-setting and Data-centric Lens","created":"2025-08-23","cited_by_count":3,"area":"alignment"},{"id":"2510.00263","title":"Judging with Confidence: Calibrating Autoraters to Preference Distributions","created":"2025-09-30","cited_by_count":3,"area":"alignment"},{"id":"2510.18081","title":"Any-Depth Alignment: Unlocking Innate Safety Alignment of LLMs to Any-Depth","created":"2025-10-20","cited_by_count":3,"area":"alignment"},{"id":"2511.20604","title":"On Evaluating LLM Alignment by Evaluating LLMs as Judges","created":"2025-11-25","cited_by_count":3,"area":"alignment"},{"id":"2512.08786","title":"A Systematic Evaluation of Preference Aggregation in Federated RLHF for Pluralistic Alignment of LLMs","created":"2025-12-09","cited_by_count":3,"area":"alignment"},{"id":"2603.06797","title":"Best-of-Tails: Bridging Optimism and Pessimism in Inference-Time Alignment","created":"2026-03-06","cited_by_count":3,"area":"alignment"},{"id":"2605.02971","title":"Multilingual Safety Alignment via Self-Distillation","created":"2026-05-03","cited_by_count":3,"area":"alignment"},{"id":"2502.20795","title":"Test-Time Alignment for Large Language Models via Textual Model Predictive Control","created":"2025-02-28","cited_by_count":2,"area":"alignment"},{"id":"2503.08035","title":"Group Preference Alignment: Customized LLM Response Generation from In-Situ Conversations","created":"2025-03-11","cited_by_count":2,"area":"alignment"},{"id":"2504.12553","title":"ELAB: Extensive LLM Alignment Benchmark in Persian Language","created":"2025-04-17","cited_by_count":2,"area":"alignment"},{"id":"2506.02479","title":"BitBypass: A New Direction in Jailbreaking Aligned Large Language Models with Bitstream Camouflage","created":"2025-06-03","cited_by_count":2,"area":"alignment"},{"id":"2507.00239","title":"Linearly Decoding Refused Knowledge in Aligned Language Models","created":"2025-06-30","cited_by_count":2,"area":"alignment"},{"id":"2508.14951","title":"Improving LLMs for Machine Translation Using Synthetic Preference Data","created":"2025-08-20","cited_by_count":2,"area":"alignment"},{"id":"2509.17116","title":"MCTS-EP: Empowering Embodied Planning with Online Preference Optimization","created":"2025-09-21","cited_by_count":2,"area":"alignment"},{"id":"2509.21798","title":"Evaluating and Improving Cultural Awareness of Reward Models for LLM Alignment","created":"2025-09-26","cited_by_count":2,"area":"alignment"},{"id":"2509.26074","title":"Limited Preference Data? Learning Better Reward Model with Latent Space Synthesis","created":"2025-09-30","cited_by_count":2,"area":"alignment"},{"id":"2511.13290","title":"Dropouts in Confidence: Moral Uncertainty in Human-LLM Alignment","created":"2025-11-17","cited_by_count":2,"area":"alignment"},{"id":"2601.08441","title":"YaPO: Learnable Sparse Activation Steering Vectors for Domain Adaptation","created":"2026-01-13","cited_by_count":2,"area":"alignment"},{"id":"2601.14032","title":"RM-Distiller: Exploiting Generative LLM for Reward Model Distillation","created":"2026-01-20","cited_by_count":2,"area":"alignment"},{"id":"2602.02572","title":"Reward Shaping for (Inference-Time) Alignment: A Stackelberg Game Perspective","created":"2026-01-31","cited_by_count":2,"area":"alignment"},{"id":"2603.12681","title":"Colluding LoRA: A Compositional Vulnerability in LLM Safety Alignment","created":"2026-03-13","cited_by_count":2,"area":"alignment"},{"id":"2606.11201","title":"To Intervene or Not: Guiding Inference-time Alignment with Probabilistic Model Blending","created":"2026-04-22","cited_by_count":2,"area":"alignment"},{"id":"2503.03460","title":"Visualising Policy-Reward Interplay to Inform Zeroth-Order Preference Optimisation of Large Language Models","created":"2025-03-05","cited_by_count":1,"area":"alignment"},{"id":"2504.06562","title":"FuseRL: Dense Preference Optimization for Heterogeneous Model Fusion","created":"2025-04-09","cited_by_count":1,"area":"alignment"},{"id":"2504.07965","title":"Cat, Rat, Meow: On the Alignment of Language Model and Human Term-Similarity Judgments","created":"2025-04-10","cited_by_count":1,"area":"alignment"},{"id":"2506.09457","title":"Towards Bridging the Reward-Generation Gap in Direct Alignment Algorithms","created":"2025-06-11","cited_by_count":1,"area":"alignment"},{"id":"2506.12382","title":"Exploring the Secondary Risks of Large Language Models","created":"2025-06-14","cited_by_count":1,"area":"alignment"},{"id":"2510.16257","title":"Towards Low-Resource Alignment to Diverse Perspectives with Sparse Feedback","created":"2025-10-17","cited_by_count":1,"area":"alignment"},{"id":"2511.12036","title":"Preference Learning from Physics-Based Feedback: Tuning Language Models to Design BCC/B2 Superalloys","created":"2025-11-15","cited_by_count":1,"area":"alignment"},{"id":"2512.11998","title":"Direct Confidence Alignment: Aligning Verbalized Confidence with Internal Confidence In Large Language Models","created":"2025-12-12","cited_by_count":1,"area":"alignment"},{"id":"2601.22083","title":"Latent Adversarial Regularization for Offline Preference Optimization","created":"2026-01-29","cited_by_count":1,"area":"alignment"},{"id":"2602.07799","title":"Fairness Aware Reward Optimization","created":"2026-02-08","cited_by_count":1,"area":"alignment"},{"id":"2603.21461","title":"DSPA: Dynamic SAE Steering for Data-Efficient Preference Alignment","created":"2026-03-23","cited_by_count":1,"area":"alignment"}],"next_cursor":"100"}