{"list":"other","total":73,"rows":[{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1707.06347","title":"Proximal Policy Optimization Algorithms","created":"2017-07-20","cited_by_count":15215},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"1706.03741","title":"Deep reinforcement learning from human preferences","created":"2017-06-12","cited_by_count":3912},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"2307.15043","title":"Universal and Transferable Adversarial Attacks on Aligned Language Models","created":"2023-07-27","cited_by_count":3104},{"id":"2212.08073","title":"Constitutional AI: Harmlessness from AI Feedback","created":"2022-12-15","cited_by_count":3050},{"id":"2202.05262","title":"Locating and Editing Factual Associations in GPT","created":"2022-02-10","cited_by_count":2691},{"id":"2204.01691","title":"Do As I Can, Not As I Say: Grounding Language in Robotic Affordances","created":"2022-04-04","cited_by_count":2348},{"id":"2308.11432","title":"A Survey on Large Language Model based Autonomous Agents","created":"2023-08-22","cited_by_count":2242},{"id":"1909.08593","title":"Fine-Tuning Language Models from Human Preferences","created":"2019-09-18","cited_by_count":2150},{"id":"2307.02483","title":"Jailbroken: How Does LLM Safety Training Fail?","created":"2023-07-05","cited_by_count":1651},{"id":"1606.06565","title":"Concrete Problems in AI Safety","created":"2016-06-21","cited_by_count":1642},{"id":"2302.12173","title":"Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection","created":"2023-02-23","cited_by_count":1443},{"id":"2310.01405","title":"Representation Engineering: A Top-Down Approach to AI Transparency","created":"2023-10-02","cited_by_count":1336},{"id":"2310.03693","title":"Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!","created":"2023-10-05","cited_by_count":1154},{"id":"2408.06292","title":"The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery","created":"2024-08-12","cited_by_count":1071},{"id":"2112.00861","title":"A General Language Assistant as a Laboratory for Alignment","created":"2021-12-01","cited_by_count":1055},{"id":"2401.05566","title":"Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training","created":"2024-01-10","cited_by_count":529},{"id":"2308.03825","title":"\"Do Anything Now\": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models","created":"2023-08-07","cited_by_count":489},{"id":"2001.09768","title":"Artificial Intelligence, Values and Alignment","created":"2020-01-13","cited_by_count":448},{"id":"1902.06705","title":"On Evaluating Adversarial Robustness","created":"2019-02-18","cited_by_count":447},{"id":"2410.09024","title":"AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents","created":"2024-10-11","cited_by_count":437},{"id":"2412.14093","title":"Alignment faking in large language models","created":"2024-12-18","cited_by_count":360},{"id":"1606.03137","title":"Cooperative Inverse Reinforcement Learning","created":"2016-06-09","cited_by_count":300},{"id":"2412.04984","title":"Frontier Models are Capable of In-context Scheming","created":"2024-12-06","cited_by_count":287},{"id":"2307.14539","title":"Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Models","created":"2023-07-26","cited_by_count":273},{"id":"2310.19852","title":"AI Alignment: A Comprehensive Survey","created":"2023-10-30","cited_by_count":263},{"id":"2209.00626","title":"The Alignment Problem from a Deep Learning Perspective","created":"2022-08-30","cited_by_count":258},{"id":"2312.06942","title":"AI Control: Improving Safety Despite Intentional Subversion","created":"2023-12-12","cited_by_count":229},{"id":"2306.12001","title":"An Overview of Catastrophic AI Risks","created":"2023-06-21","cited_by_count":222},{"id":"2404.09932","title":"Foundational Challenges in Assuring Alignment and Safety of Large Language Models","created":"2024-04-15","cited_by_count":199},{"id":"2305.15324","title":"Model evaluation for extreme risks","created":"2023-05-24","cited_by_count":177},{"id":"2103.14659","title":"Alignment of Language Agents","created":"2021-03-26","cited_by_count":168},{"id":"2310.11986","title":"Sociotechnical Safety Evaluation of Generative AI Systems","created":"2023-10-18","cited_by_count":157},{"id":"2309.10062","title":"SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models","created":"2023-09-18","cited_by_count":153},{"id":"2311.07590","title":"Large Language Models can Strategically Deceive their Users when Put Under Pressure","created":"2023-11-09","cited_by_count":146},{"id":"2308.10741","title":"On the Adversarial Robustness of Multi-Modal Foundation Models","created":"2023-08-21","cited_by_count":145},{"id":"2302.10329","title":"Harms from Increasingly Agentic Algorithmic Systems","created":"2023-02-20","cited_by_count":135},{"id":"2401.14446","title":"Black-Box Access is Insufficient for Rigorous AI Audits","created":"2024-01-25","cited_by_count":126},{"id":"2105.14111","title":"Goal Misgeneralization in Deep Reinforcement Learning","created":"2021-05-28","cited_by_count":123},{"id":"1912.01683","title":"Optimal Policies Tend to Seek Power","created":"2019-12-03","cited_by_count":119},{"id":"2311.12786","title":"Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks","created":"2023-11-21","cited_by_count":115},{"id":"2206.13353","title":"Is Power-Seeking AI an Existential Risk?","created":"2022-06-16","cited_by_count":105},{"id":"2401.12963","title":"AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents","created":"2024-01-23","cited_by_count":87},{"id":"2407.20859","title":"Breaking Agents: Compromising Autonomous LLM Agents Through Malfunction Amplification","created":"2024-07-30","cited_by_count":81},{"id":"2102.03896","title":"Consequences of Misaligned AI","created":"2021-02-07","cited_by_count":80},{"id":"2401.13138","title":"Visibility into AI Agents","created":"2024-01-23","cited_by_count":79},{"id":"2206.04737","title":"Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance","created":"2022-06-09","cited_by_count":67},{"id":"2302.04844","title":"The Gradient of Generative AI Release: Methods and Considerations","created":"2023-02-05","cited_by_count":63},{"id":"2205.01663","title":"Adversarial Training for High-Stakes Reliability","created":"2022-05-03","cited_by_count":60},{"id":"2211.08422","title":"Mechanistic Mode Connectivity","created":"2022-11-15","cited_by_count":50},{"id":"2401.02843","title":"Thousands of AI Authors on the Future of AI","created":"2024-01-05","cited_by_count":48},{"id":"2403.10462","title":"Safety Cases: How to Justify the Safety of Advanced AI Systems","created":"2024-03-15","cited_by_count":48},{"id":"2501.16946","title":"Gradual Disempowerment: Systemic Existential Risks from Incremental AI Development","created":"2025-01-28","cited_by_count":46},{"id":"2401.03217","title":"Understanding Large-Language Model (LLM)-powered Human-Robot Interaction","created":"2024-01-06","cited_by_count":43},{"id":"2009.13676","title":"The Grey Hoodie Project: Big Tobacco, Big Tech, and the threat on academic integrity","created":"2020-09-28","cited_by_count":38},{"id":"2306.03809","title":"Can large language models democratize access to dual-use biotechnology?","created":"2023-06-06","cited_by_count":35},{"id":"2503.07885","title":"Safety Guardrails for LLM-Enabled Robots","created":"2025-03-10","cited_by_count":35},{"id":"2303.12642","title":"Democratising AI: Multiple Meanings, Goals, and Methods","created":"2023-03-22","cited_by_count":29},{"id":"2305.02797","title":"The Elephant in the Room: Analyzing the Presence of Big Tech in Natural Language Processing Research","created":"2023-05-04","cited_by_count":27},{"id":"2306.06924","title":"TASRA: a Taxonomy and Analysis of Societal-Scale Risks from AI","created":"2023-06-12","cited_by_count":26},{"id":"2401.07836","title":"Two Types of AI Existential Risk: Decisive and Accumulative","created":"2024-01-15","cited_by_count":22},{"id":"2403.04471","title":"The Shutdown Problem: An AI Engineering Puzzle for Decision Theorists","created":"2024-03-07","cited_by_count":22},{"id":"2406.13843","title":"Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data","created":"2024-06-19","cited_by_count":20},{"id":"2410.21572","title":"Safety cases for frontier AI","created":"2024-10-28","cited_by_count":18},{"id":"2411.01042","title":"Introduction to AI Safety, Ethics, and Society","created":"2024-11-01","cited_by_count":15},{"id":"2209.10604","title":"Current and Near-Term AI as a Potential Existential Risk Factor","created":"2022-09-21","cited_by_count":14},{"id":"2310.13625","title":"Oversight for Frontier AI through a Know-Your-Customer Scheme for Compute Providers","created":"2023-10-20","cited_by_count":13},{"id":"2405.10295","title":"Societal Adaptation to Advanced AI","created":"2024-05-16","cited_by_count":10},{"id":"2006.05203","title":"The Tragedy of the AI Commons","created":"2020-06-09","cited_by_count":7},{"id":"2501.14749","title":"The Manhattan Trap: Why a Race to Artificial Superintelligence is Self-Defeating","created":"2024-12-22","cited_by_count":4},{"id":"2311.02147","title":"The Alignment Problem in Context","created":"2023-11-03","cited_by_count":3}],"next_cursor":null}