{"list":"other","total":160,"rows":[{"id":"2103.00020","title":"Learning Transferable Visual Models From Natural Language Supervision","created":"2021-02-26","cited_by_count":33744},{"id":"1405.0312","title":"Microsoft COCO: Common Objects in Context","created":"2014-05-01","cited_by_count":17608},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1707.06347","title":"Proximal Policy Optimization Algorithms","created":"2017-07-20","cited_by_count":15215},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2106.09685","title":"LoRA: Low-Rank Adaptation of Large Language Models","created":"2021-06-17","cited_by_count":14380},{"id":"2307.09288","title":"Llama 2: Open Foundation and Fine-Tuned Chat Models","created":"2023-07-18","cited_by_count":13028},{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"1503.03585","title":"Deep Unsupervised Learning using Nonequilibrium Thermodynamics","created":"2015-03-12","cited_by_count":7058},{"id":"2205.11487","title":"Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding","created":"2022-05-23","cited_by_count":6355},{"id":"2203.00667","title":"Generative Adversarial Networks","created":"2022-03-01","cited_by_count":5627},{"id":"1512.00567","title":"Rethinking the Inception Architecture for Computer Vision","created":"2015-12-02","cited_by_count":5475},{"id":"1506.02142","title":"Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning","created":"2015-06-06","cited_by_count":4448},{"id":"2210.08402","title":"LAION-5B: An open large-scale dataset for training next generation image-text models","created":"2022-10-16","cited_by_count":4152},{"id":"1706.03741","title":"Deep reinforcement learning from human preferences","created":"2017-06-12","cited_by_count":3912},{"id":"2112.10741","title":"GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models","created":"2021-12-20","cited_by_count":3614},{"id":"2212.08073","title":"Constitutional AI: Harmlessness from AI Feedback","created":"2022-12-15","cited_by_count":3050},{"id":"1606.03498","title":"Improved Techniques for Training GANs","created":"2016-06-10","cited_by_count":2970},{"id":"2009.01325","title":"Learning to summarize from human feedback","created":"2020-09-02","cited_by_count":2588},{"id":"2208.01626","title":"Prompt-to-Prompt Image Editing with Cross Attention Control","created":"2022-08-02","cited_by_count":2431},{"id":"1703.04977","title":"What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?","created":"2017-03-15","cited_by_count":2352},{"id":"2408.03314","title":"Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters","created":"2024-08-06","cited_by_count":1986},{"id":"2005.01643","title":"Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems","created":"2020-05-04","cited_by_count":1920},{"id":"1907.02893","title":"Invariant Risk Minimization","created":"2019-07-05","cited_by_count":1854},{"id":"2210.02303","title":"Imagen Video: High Definition Video Generation with Diffusion Models","created":"2022-10-05","cited_by_count":1778},{"id":"2112.09332","title":"WebGPT: Browser-assisted question-answering with human feedback","created":"2021-12-17","cited_by_count":1745},{"id":"1703.04730","title":"Understanding Black-box Predictions via Influence Functions","created":"2017-03-14","cited_by_count":1741},{"id":"1504.00325","title":"Microsoft COCO Captions: Data Collection and Evaluation Server","created":"2015-04-01","cited_by_count":1462},{"id":"2009.09761","title":"DiffWave: A Versatile Diffusion Model for Audio Synthesis","created":"2020-09-21","cited_by_count":1354},{"id":"2310.03693","title":"Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!","created":"2023-10-05","cited_by_count":1154},{"id":"2305.11206","title":"LIMA: Less Is More for Alignment","created":"2023-05-18","cited_by_count":1100},{"id":"2210.10760","title":"Scaling Laws for Reward Model Overoptimization","created":"2022-10-19","cited_by_count":1095},{"id":"2112.00861","title":"A General Language Assistant as a Laboratory for Alignment","created":"2021-12-01","cited_by_count":1055},{"id":"2211.01910","title":"Large Language Models Are Human-Level Prompt Engineers","created":"2022-11-03","cited_by_count":1045},{"id":"2304.05977","title":"ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generation","created":"2023-04-12","cited_by_count":1045},{"id":"2305.13301","title":"Training Diffusion Models with Reinforcement Learning","created":"2023-05-22","cited_by_count":982},{"id":"2305.01569","title":"Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation","created":"2023-05-02","cited_by_count":977},{"id":"2310.11513","title":"GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment","created":"2023-10-17","cited_by_count":972},{"id":"2405.14734","title":"SimPO: Simple Preference Optimization with a Reference-Free Reward","created":"2024-05-23","cited_by_count":963},{"id":"2310.12036","title":"A General Theoretical Paradigm to Understand Learning from Human Preferences","created":"2023-10-18","cited_by_count":912},{"id":"2302.00487","title":"A Comprehensive Survey of Continual Learning: Theory, Method and Application","created":"2023-01-31","cited_by_count":872},{"id":"1604.06174","title":"Training Deep Nets with Sublinear Memory Cost","created":"2016-04-21","cited_by_count":848},{"id":"2209.06794","title":"PaLI: A Jointly-Scaled Multilingual Language-Image Model","created":"2022-09-14","cited_by_count":766},{"id":"2305.14387","title":"AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback","created":"2023-05-22","cited_by_count":748},{"id":"2310.16834","title":"Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution","created":"2023-10-25","cited_by_count":745},{"id":"2301.13826","title":"Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models","created":"2023-01-31","cited_by_count":702},{"id":"2304.06767","title":"RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment","created":"2023-04-13","cited_by_count":686},{"id":"2401.10020","title":"Self-Rewarding Language Models","created":"2024-01-18","cited_by_count":681},{"id":"2006.09359","title":"AWAC: Accelerating Online Reinforcement Learning with Offline Datasets","created":"2020-06-16","cited_by_count":671},{"id":"2309.00267","title":"RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedback","created":"2023-09-01","cited_by_count":625},{"id":"2102.07350","title":"Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm","created":"2021-02-15","cited_by_count":606},{"id":"2403.07691","title":"ORPO: Monolithic Preference Optimization without Reference Model","created":"2024-03-12","cited_by_count":562},{"id":"2203.02923","title":"GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation","created":"2022-03-06","cited_by_count":516},{"id":"2404.01291","title":"Evaluating Text-to-Visual Generation with Image-to-Text Generation","created":"2024-04-01","cited_by_count":474},{"id":"2312.09390","title":"Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision","created":"2023-12-14","cited_by_count":467},{"id":"2304.05302","title":"RRHF: Rank Responses to Align Language Models with Human Feedback without tears","created":"2023-04-11","cited_by_count":463},{"id":"2309.17400","title":"Directly Fine-Tuning Diffusion Models on Differentiable Rewards","created":"2023-09-29","cited_by_count":448},{"id":"2108.13624","title":"Towards Out-Of-Distribution Generalization: A Survey","created":"2021-08-31","cited_by_count":436},{"id":"2302.12192","title":"Aligning Text-to-Image Models using Human Feedback","created":"2023-02-23","cited_by_count":422},{"id":"2312.00849","title":"RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback","created":"2023-12-01","cited_by_count":412},{"id":"2310.01377","title":"UltraFeedback: Boosting Language Models with Scaled AI Feedback","created":"2023-10-02","cited_by_count":406},{"id":"2210.14896","title":"DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models","created":"2022-10-26","cited_by_count":379},{"id":"2312.15685","title":"What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning","created":"2023-12-25","cited_by_count":364},{"id":"2312.11456","title":"Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraint","created":"2023-12-18","cited_by_count":350},{"id":"1710.10571","title":"Certifying Some Distributional Robustness with Principled Adversarial Training","created":"2017-10-29","cited_by_count":337},{"id":"2301.12661","title":"Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models","created":"2023-01-30","cited_by_count":324},{"id":"2309.06657","title":"Statistical Rejection Sampling Improves Preference Optimization","created":"2023-09-13","cited_by_count":323},{"id":"2305.03047","title":"Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision","created":"2023-05-04","cited_by_count":318},{"id":"2303.16203","title":"Your Diffusion Model is Secretly a Zero-Shot Classifier","created":"2023-03-28","cited_by_count":306},{"id":"2310.03739","title":"Aligning Text-to-Image Diffusion Models with Reward Backpropagation","created":"2023-10-05","cited_by_count":288},{"id":"2303.14420","title":"Human Preference Score: Better Aligning Text-to-Image Models with Human Preference","created":"2023-03-25","cited_by_count":287},{"id":"2306.17492","title":"Preference Ranking Optimization for Human Alignment","created":"2023-06-30","cited_by_count":285},{"id":"1906.10652","title":"Monte Carlo Gradient Estimation in Machine Learning","created":"2019-06-25","cited_by_count":283},{"id":"2405.07863","title":"RLHF Workflow: From Reward Modeling to Online RLHF","created":"2024-05-13","cited_by_count":267},{"id":"2404.10719","title":"Is DPO Superior to PPO for LLM Alignment? A Comprehensive Study","created":"2024-04-16","cited_by_count":262},{"id":"2402.04792","title":"Direct Language Model Alignment from Online AI Feedback","created":"2024-02-07","cited_by_count":260},{"id":"2303.17189","title":"LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation","created":"2023-03-30","cited_by_count":259},{"id":"2311.13231","title":"Using Human Feedback to Fine-tune Diffusion Models without Any Reward Model","created":"2023-11-22","cited_by_count":252},{"id":"2306.04488","title":"Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewards","created":"2023-06-07","cited_by_count":243},{"id":"2405.00675","title":"Self-Play Preference Optimization for Language Model Alignment","created":"2024-05-01","cited_by_count":232},{"id":"2402.05162","title":"Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications","created":"2024-02-07","cited_by_count":231},{"id":"2202.04053","title":"DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models","created":"2022-02-08","cited_by_count":230},{"id":"2312.00886","title":"Nash Learning from Human Feedback","created":"2023-12-01","cited_by_count":224},{"id":"2401.11708","title":"Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs","created":"2024-01-22","cited_by_count":224},{"id":"2109.06977","title":"Design Guidelines for Prompt Engineering Text-to-Image Generative Models","created":"2021-09-14","cited_by_count":218},{"id":"2005.12729","title":"Implementation Matters in Deep Policy Gradients: A Case Study on PPO and TRPO","created":"2020-05-25","cited_by_count":186},{"id":"1604.03605","title":"What do different evaluation metrics tell us about saliency models?","created":"2016-04-12","cited_by_count":185},{"id":"2401.01967","title":"A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity","created":"2024-01-03","cited_by_count":185},{"id":"2404.14367","title":"Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Data","created":"2024-04-22","cited_by_count":185},{"id":"2402.10207","title":"Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment","created":"2024-02-15","cited_by_count":175},{"id":"2309.16240","title":"Beyond Reverse KL: Generalizing Direct Preference Optimization with Diverse Divergence Constraints","created":"2023-09-28","cited_by_count":174},{"id":"2303.09618","title":"HIVE: Harnessing Human Feedback for Instructional Visual Editing","created":"2023-03-16","cited_by_count":173},{"id":"2306.08877","title":"Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignment","created":"2023-06-15","cited_by_count":171},{"id":"2402.05749","title":"Generalized Preference Optimization: A Unified Approach to Offline Alignment","created":"2024-02-08","cited_by_count":157},{"id":"2303.15233","title":"Text-to-Image Diffusion Models are Zero-Shot Classifiers","created":"2023-03-27","cited_by_count":143},{"id":"2402.15194","title":"Fine-Tuning of Continuous-Time Diffusion Models as Entropy-Regularized Control","created":"2024-02-23","cited_by_count":143},{"id":"2206.11871","title":"Offline RL for Natural Language Generation with Implicit Language Q Learning","created":"2022-06-05","cited_by_count":138},{"id":"2403.00409","title":"Provably Robust DPO: Aligning Language Models with Noisy Feedback","created":"2024-03-01","cited_by_count":135},{"id":"2205.09329","title":"Dataset Pruning: Reducing Training Data by Examining Generalization Influence","created":"2022-05-19","cited_by_count":133}],"next_cursor":"100"}