{"list":"other","total":258,"rows":[{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"2304.03442","title":"Generative Agents: Interactive Simulacra of Human Behavior","created":"2023-04-07","cited_by_count":3568},{"id":"1909.08593","title":"Fine-Tuning Language Models from Human Preferences","created":"2019-09-18","cited_by_count":2150},{"id":"1606.06565","title":"Concrete Problems in AI Safety","created":"2016-06-21","cited_by_count":1642},{"id":"2310.03693","title":"Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!","created":"2023-10-05","cited_by_count":1154},{"id":"2112.00861","title":"A General Language Assistant as a Laboratory for Alignment","created":"2021-12-01","cited_by_count":1055},{"id":"2305.14975","title":"Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedback","created":"2023-05-24","cited_by_count":812},{"id":"2305.11738","title":"CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing","created":"2023-05-19","cited_by_count":783},{"id":"2303.17548","title":"Whose Opinions Do Language Models Reflect?","created":"2023-03-30","cited_by_count":773},{"id":"2209.07858","title":"Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned","created":"2022-08-23","cited_by_count":729},{"id":"2304.06767","title":"RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment","created":"2023-04-13","cited_by_count":686},{"id":"2310.12773","title":"Safe RLHF: Safe Reinforcement Learning from Human Feedback","created":"2023-10-19","cited_by_count":656},{"id":"2310.12931","title":"Eureka: Human-Level Reward Design via Coding Large Language Models","created":"2023-10-19","cited_by_count":571},{"id":"2309.15817","title":"Identifying the Risks of LM Agents with an LM-Emulated Sandbox","created":"2023-09-25","cited_by_count":548},{"id":"2304.05302","title":"RRHF: Rank Responses to Align Language Models with Human Feedback without tears","created":"2023-04-11","cited_by_count":463},{"id":"2001.09768","title":"Artificial Intelligence, Values and Alignment","created":"2020-01-13","cited_by_count":448},{"id":"2404.14082","title":"Mechanistic Interpretability for AI Safety -- A Review","created":"2024-04-22","cited_by_count":422},{"id":"2306.01693","title":"Fine-Grained Human Feedback Gives Better Rewards for Language Model Training","created":"2023-06-02","cited_by_count":401},{"id":"2006.14779","title":"Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance","created":"2020-06-26","cited_by_count":399},{"id":"2310.11667","title":"SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents","created":"2023-10-18","cited_by_count":367},{"id":"2312.15685","title":"What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning","created":"2023-12-25","cited_by_count":364},{"id":"1910.05789","title":"On the Utility of Learning about Humans for Human-AI Coordination","created":"2019-10-13","cited_by_count":349},{"id":"2309.01029","title":"Explainability for Large Language Models: A Survey","created":"2023-09-02","cited_by_count":333},{"id":"2201.03544","title":"The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models","created":"2022-01-10","cited_by_count":328},{"id":"2305.03047","title":"Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision","created":"2023-05-04","cited_by_count":318},{"id":"2305.16739","title":"AlignScore: Evaluating Factual Consistency with a Unified Alignment Function","created":"2023-05-26","cited_by_count":288},{"id":"2306.17492","title":"Preference Ranking Optimization for Human Alignment","created":"2023-06-30","cited_by_count":285},{"id":"2110.01691","title":"AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Prompts","created":"2021-10-04","cited_by_count":268},{"id":"1812.05239","title":"Improving fairness in machine learning systems: What do industry practitioners need?","created":"2018-12-13","cited_by_count":262},{"id":"2305.08283","title":"From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Models","created":"2023-05-15","cited_by_count":260},{"id":"2209.00626","title":"The Alignment Problem from a Deep Learning Perspective","created":"2022-08-30","cited_by_count":258},{"id":"2312.01552","title":"The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning","created":"2023-12-04","cited_by_count":257},{"id":"2011.00620","title":"Social Chemistry 101: Learning to Reason about Social and Moral Norms","created":"2020-11-01","cited_by_count":255},{"id":"2001.02478","title":"Questioning the AI: Informing Design Practices for Explainable AI User Experiences","created":"2020-01-08","cited_by_count":253},{"id":"2310.17389","title":"ToxicChat: Unveiling Hidden Challenges of Toxicity Detection in Real-World User-AI Conversation","created":"2023-10-26","cited_by_count":231},{"id":"2310.17884","title":"Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory","created":"2023-10-27","cited_by_count":230},{"id":"2311.08401","title":"Fine-tuning Language Models for Factuality","created":"2023-11-14","cited_by_count":221},{"id":"2105.04054","title":"Societal Biases in Language Generation: Progress and Challenges","created":"2021-05-10","cited_by_count":202},{"id":"2201.05955","title":"WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation","created":"2022-01-16","cited_by_count":202},{"id":"2307.10928","title":"FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets","created":"2023-07-20","cited_by_count":201},{"id":"2404.09932","title":"Foundational Challenges in Assuring Alignment and Safety of Large Language Models","created":"2024-04-15","cited_by_count":199},{"id":"2005.01831","title":"Evaluating Explainable AI: Which Algorithmic Explanations Help Users Predict Model Behavior?","created":"2020-05-04","cited_by_count":190},{"id":"2304.03279","title":"Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmark","created":"2023-04-06","cited_by_count":182},{"id":"2310.15421","title":"FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions","created":"2023-10-24","cited_by_count":171},{"id":"2305.14552","title":"Sources of Hallucination by Large Language Models on Inference Tasks","created":"2023-05-23","cited_by_count":169},{"id":"2310.05470","title":"Generative Judge for Evaluating Alignment","created":"2023-10-09","cited_by_count":169},{"id":"2305.17390","title":"SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks","created":"2023-05-27","cited_by_count":168},{"id":"2302.00560","title":"Co-Writing with Opinionated Language Models Affects Users' Views","created":"2023-02-01","cited_by_count":148},{"id":"2310.10701","title":"Theory of Mind for Multi-Agent Collaboration via Large Language Models","created":"2023-10-16","cited_by_count":135},{"id":"2008.05122","title":"The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Models","created":"2020-08-12","cited_by_count":125},{"id":"2112.08674","title":"Reframing Human-AI Collaboration for Generating Free-Text Explanations","created":"2021-12-16","cited_by_count":125},{"id":"2306.04140","title":"Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventions","created":"2023-06-07","cited_by_count":125},{"id":"2206.07550","title":"Evaluating and Inducing Personality in Pre-trained Language Models","created":"2022-05-20","cited_by_count":123},{"id":"2212.06823","title":"Explanations Can Reduce Overreliance on AI Systems During Decision-Making","created":"2022-12-13","cited_by_count":111},{"id":"2310.05344","title":"SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF","created":"2023-10-09","cited_by_count":111},{"id":"2305.08844","title":"RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputs","created":"2023-05-15","cited_by_count":105},{"id":"2302.02337","title":"Regulating ChatGPT and other Large Generative AI Models","created":"2023-02-05","cited_by_count":104},{"id":"2310.00166","title":"Motif: Intrinsic Motivation from Artificial Intelligence Feedback","created":"2023-09-29","cited_by_count":102},{"id":"2202.12299","title":"Capturing Failures of Large Language Models via Human Cognitive Biases","created":"2022-02-24","cited_by_count":98},{"id":"2306.01943","title":"NLPositionality: Characterizing Design Biases of Datasets and Models","created":"2023-06-02","cited_by_count":94},{"id":"2310.15638","title":"CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation","created":"2023-10-24","cited_by_count":94},{"id":"2305.11391","title":"A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation","created":"2023-05-19","cited_by_count":93},{"id":"2212.09746","title":"Evaluating Human-Language Model Interaction","created":"2022-12-19","cited_by_count":92},{"id":"2305.19148","title":"Mitigating Label Biases for In-context Learning","created":"2023-05-28","cited_by_count":89},{"id":"2001.05871","title":"\"Why is 'Chicago' deceptive?\" Towards Building Model-Driven Tutorials for Humans","created":"2020-01-14","cited_by_count":86},{"id":"2208.11663","title":"PEER: A Collaborative Language Model","created":"2022-08-24","cited_by_count":86},{"id":"2108.04308","title":"Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Development","created":"2021-08-09","cited_by_count":85},{"id":"2302.02187","title":"Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations","created":"2023-02-04","cited_by_count":83},{"id":"2310.05199","title":"Loose lips sink ships: Mitigating Length Bias in Reinforcement Learning from Human Feedback","created":"2023-10-08","cited_by_count":78},{"id":"2305.02466","title":"Cognitive Reframing of Negative Thoughts through Human-Language Model Interaction","created":"2023-05-04","cited_by_count":77},{"id":"2305.13412","title":"Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Method","created":"2023-05-22","cited_by_count":76},{"id":"2403.14117","title":"A Design Space for Intelligent and Interactive Writing Assistants","created":"2024-03-21","cited_by_count":76},{"id":"2305.13735","title":"Aligning Large Language Models through Synthetic Feedback","created":"2023-05-23","cited_by_count":75},{"id":"1909.09251","title":"AllenNLP Interpret: A Framework for Explaining Predictions of NLP Models","created":"2019-09-19","cited_by_count":74},{"id":"2309.13633","title":"EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria","created":"2023-09-24","cited_by_count":74},{"id":"2310.05418","title":"Humanoid Agents: Platform for Simulating Human-like Generative Agents","created":"2023-10-09","cited_by_count":73},{"id":"2306.00186","title":"Factually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedback","created":"2023-05-31","cited_by_count":72},{"id":"2310.06830","title":"Lemur: Harmonizing Natural Language and Code for Language Agents","created":"2023-10-10","cited_by_count":72},{"id":"2204.11788","title":"Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation","created":"2022-04-25","cited_by_count":67},{"id":"2301.05809","title":"Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making","created":"2023-01-14","cited_by_count":67},{"id":"2306.03917","title":"Turning large language models into cognitive models","created":"2023-06-06","cited_by_count":67},{"id":"2305.11473","title":"Graphologue: Exploring Large Language Model Responses with Interactive Diagrams","created":"2023-05-19","cited_by_count":66},{"id":"2212.08620","title":"POTATO: The Portable Text Annotation Tool","created":"2022-12-16","cited_by_count":64},{"id":"2310.07251","title":"Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMs","created":"2023-10-11","cited_by_count":64},{"id":"2402.04559","title":"Can Large Language Model Agents Simulate Human Trust Behavior?","created":"2024-02-07","cited_by_count":64},{"id":"2305.14938","title":"Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark","created":"2023-05-24","cited_by_count":63},{"id":"2310.11523","title":"Group Preference Optimization: Few-Shot Alignment of Large Language Models","created":"2023-10-17","cited_by_count":63},{"id":"2310.16755","title":"HI-TOM: A Benchmark for Evaluating Higher-Order Theory of Mind Reasoning in Large Language Models","created":"2023-10-25","cited_by_count":63},{"id":"2101.05303","title":"Understanding the Effect of Out-of-distribution Examples and Interactive Explanations on Human-AI Decision Making","created":"2021-01-13","cited_by_count":58},{"id":"2309.14049","title":"How Novices Use LLM-Based Code Generators to Solve CS1 Coding Tasks in a Self-Paced Learning Environment","created":"2023-09-25","cited_by_count":56},{"id":"2309.12309","title":"Rehearsal: Simulating Conflict to Teach Conflict Resolution","created":"2023-09-21","cited_by_count":55},{"id":"1810.09648","title":"What can AI do for me: Evaluating Machine Learning Interpretations in Cooperative Play","created":"2018-10-23","cited_by_count":53},{"id":"2202.05402","title":"Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning","created":"2022-02-11","cited_by_count":53},{"id":"2311.18140","title":"ROBBIE: Robust Bias Evaluation of Large Generative Language Models","created":"2023-11-29","cited_by_count":53},{"id":"2402.14606","title":"Towards Diverse Behaviors: A Benchmark for Imitation Learning with Human Demonstrations","created":"2024-02-22","cited_by_count":53},{"id":"2012.06046","title":"Interactive Weak Supervision: Learning Useful Heuristics for Data Labeling","created":"2020-12-11","cited_by_count":52},{"id":"2306.01857","title":"Knowledge of cultural moral norms in large language models","created":"2023-06-02","cited_by_count":51},{"id":"2305.13299","title":"Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations","created":"2023-05-22","cited_by_count":49}],"next_cursor":"100"}