{"list":"other","total":157,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"2106.09685","title":"LoRA: Low-Rank Adaptation of Large Language Models","created":"2021-06-17","cited_by_count":14380},{"id":"2302.13971","title":"LLaMA: Open and Efficient Foundation Language Models","created":"2023-02-27","cited_by_count":14132},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"2002.05709","title":"A Simple Framework for Contrastive Learning of Visual Representations","created":"2020-02-13","cited_by_count":12049},{"id":"2107.03374","title":"Evaluating Large Language Models Trained on Code","created":"2021-07-07","cited_by_count":8320},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1910.13461","title":"BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension","created":"2019-10-29","cited_by_count":5893},{"id":"2204.02311","title":"PaLM: Scaling Language Modeling with Pathways","created":"2022-04-05","cited_by_count":5326},{"id":"2205.11916","title":"Large Language Models are Zero-Shot Reasoners","created":"2022-05-24","cited_by_count":4374},{"id":"1910.01108","title":"DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter","created":"2019-10-02","cited_by_count":4307},{"id":"1902.00751","title":"Parameter-Efficient Transfer Learning for NLP","created":"2019-02-02","cited_by_count":4236},{"id":"2104.08691","title":"The Power of Scale for Parameter-Efficient Prompt Tuning","created":"2021-04-18","cited_by_count":3795},{"id":"2303.17651","title":"Self-Refine: Iterative Refinement with Self-Feedback","created":"2023-03-30","cited_by_count":3442},{"id":"2101.03961","title":"Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity","created":"2021-01-11","cited_by_count":3073},{"id":"2212.08073","title":"Constitutional AI: Harmlessness from AI Feedback","created":"2022-12-15","cited_by_count":3050},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"2303.12712","title":"Sparks of Artificial General Intelligence: Early experiments with GPT-4","created":"2023-03-22","cited_by_count":2592},{"id":"2107.13586","title":"Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing","created":"2021-07-28","cited_by_count":2234},{"id":"2312.10997","title":"Retrieval-Augmented Generation for Large Language Models: A Survey","created":"2023-12-18","cited_by_count":2212},{"id":"2006.03654","title":"DeBERTa: Decoding-enhanced BERT with Disentangled Attention","created":"2020-06-05","cited_by_count":2181},{"id":"2308.12950","title":"Code Llama: Open Foundation Models for Code","created":"2023-08-24","cited_by_count":2139},{"id":"2403.13372","title":"LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models","created":"2024-03-20","cited_by_count":1464},{"id":"2302.12173","title":"Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection","created":"2023-02-23","cited_by_count":1443},{"id":"2309.07864","title":"The Rise and Potential of Large Language Model Based Agents: A Survey","created":"2023-09-14","cited_by_count":1439},{"id":"2002.08155","title":"CodeBERT: A Pre-Trained Model for Programming and Natural Languages","created":"2020-02-19","cited_by_count":1310},{"id":"2310.03693","title":"Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!","created":"2023-10-05","cited_by_count":1154},{"id":"1911.12543","title":"How Can We Know What Language Models Know?","created":"2019-11-28","cited_by_count":959},{"id":"2109.00859","title":"CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation","created":"2021-09-02","cited_by_count":906},{"id":"2203.13474","title":"CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis","created":"2022-03-25","cited_by_count":885},{"id":"2306.01116","title":"The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only","created":"2023-06-01","cited_by_count":763},{"id":"2305.02301","title":"Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes","created":"2023-05-03","cited_by_count":737},{"id":"2301.00234","title":"A Survey on In-context Learning","created":"2022-12-31","cited_by_count":721},{"id":"2107.06499","title":"Deduplicating Training Data Makes Language Models Better","created":"2021-07-14","cited_by_count":714},{"id":"2306.08302","title":"Unifying Large Language Models and Knowledge Graphs: A Roadmap","created":"2023-06-14","cited_by_count":668},{"id":"2009.08366","title":"GraphCodeBERT: Pre-training Code Representations with Data Flow","created":"2020-09-17","cited_by_count":609},{"id":"2306.05499","title":"Prompt Injection attack against LLM-integrated Applications","created":"2023-06-08","cited_by_count":605},{"id":"1707.00600","title":"Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Ugly","created":"2017-07-03","cited_by_count":538},{"id":"2204.05999","title":"InCoder: A Generative Model for Code Infilling and Synthesis","created":"2022-04-12","cited_by_count":498},{"id":"2203.09509","title":"ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection","created":"2022-03-17","cited_by_count":422},{"id":"1905.05583","title":"How to Fine-Tune BERT for Text Classification?","created":"2019-05-14","cited_by_count":411},{"id":"2304.13712","title":"Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond","created":"2023-04-26","cited_by_count":411},{"id":"2308.10620","title":"Large Language Models for Software Engineering: A Systematic Literature Review","created":"2023-08-21","cited_by_count":399},{"id":"2312.02003","title":"A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly","created":"2023-12-04","cited_by_count":387},{"id":"2002.06305","title":"Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping","created":"2020-02-15","cited_by_count":384},{"id":"2103.06333","title":"Unified Pre-training for Program Understanding and Generation","created":"2021-03-10","cited_by_count":366},{"id":"1811.12560","title":"An Introduction to Deep Reinforcement Learning","created":"2018-11-30","cited_by_count":206},{"id":"2303.10158","title":"Data-centric Artificial Intelligence: A Survey","created":"2023-03-17","cited_by_count":203},{"id":"2306.09896","title":"Is Self-Repair a Silver Bullet for Code Generation?","created":"2023-06-16","cited_by_count":197},{"id":"2211.03622","title":"Do Users Write More Insecure Code with AI Assistants?","created":"2022-11-07","cited_by_count":192},{"id":"2402.00888","title":"Security and Privacy Challenges of Large Language Models: A Survey","created":"2024-01-30","cited_by_count":186},{"id":"2307.08715","title":"MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbots","created":"2023-07-16","cited_by_count":183},{"id":"2402.18013","title":"A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems","created":"2024-02-28","cited_by_count":170},{"id":"2306.09782","title":"Full Parameter Fine-tuning for Large Language Models with Limited Resources","created":"2023-06-16","cited_by_count":134},{"id":"2305.18486","title":"A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets","created":"2023-05-29","cited_by_count":123},{"id":"1802.09089","title":"Kitsune: An Ensemble of Autoencoders for Online Network Intrusion Detection","created":"2018-02-25","cited_by_count":121},{"id":"2303.07263","title":"InferFix: End-to-End Program Repair with LLMs","created":"2023-03-13","cited_by_count":114},{"id":"2301.08653","title":"An Analysis of the Automatic Bug Fixing Performance of ChatGPT","created":"2023-01-20","cited_by_count":110},{"id":"2112.02125","title":"Examining Zero-Shot Vulnerability Repair with Large Language Models","created":"2021-12-03","cited_by_count":105},{"id":"2304.00409","title":"DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection","created":"2023-04-01","cited_by_count":102},{"id":"2308.06782","title":"PentestGPT: An LLM-empowered Automatic Penetration Testing Tool","created":"2023-08-13","cited_by_count":97},{"id":"2312.12575","title":"LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarks","created":"2023-12-19","cited_by_count":97},{"id":"2305.15778","title":"Automatic Root Cause Analysis via Large Language Models for Cloud Incidents","created":"2023-05-25","cited_by_count":84},{"id":"2207.08281","title":"Less Training, More Repairing Please: Revisiting Automated Program Repair via Zero-shot Learning","created":"2022-07-17","cited_by_count":76},{"id":"2102.03983","title":"Partial Is Better Than All: Revisiting Fine-tuning Strategy for Few-shot Learning","created":"2021-02-08","cited_by_count":72},{"id":"2402.18041","title":"Datasets for Large Language Models: A Comprehensive Survey","created":"2024-02-28","cited_by_count":71},{"id":"2310.01726","title":"Large Language Models for Test-Free Fault Localization","created":"2023-10-03","cited_by_count":67},{"id":"2308.03314","title":"GPTScan: Detecting Logic Vulnerabilities in Smart Contracts by Combining GPT with Program Analysis","created":"2023-08-07","cited_by_count":65},{"id":"2011.01513","title":"CharBERT: Character-aware Pre-trained Language Model","created":"2020-11-03","cited_by_count":63},{"id":"2311.07989","title":"Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Code","created":"2023-11-14","cited_by_count":62},{"id":"2204.02685","title":"SecureBERT: A Domain-Specific Language Model for Cybersecurity","created":"2022-04-06","cited_by_count":60},{"id":"2311.16169","title":"Understanding the Effectiveness of Large Language Models in Detecting Security Vulnerabilities","created":"2023-11-16","cited_by_count":59},{"id":"2305.18607","title":"How Effective Are Neural Networks for Fixing Security Vulnerabilities","created":"2023-05-29","cited_by_count":52},{"id":"2308.12697","title":"Prompt-Enhanced Software Vulnerability Detection Using ChatGPT","created":"2023-08-24","cited_by_count":51},{"id":"2312.15698","title":"RepairLLaMA: Efficient Representations and Fine-Tuned Adapters for Program Repair","created":"2023-12-25","cited_by_count":50},{"id":"2307.10719","title":"LLM Censorship: A Machine Learning Challenge or a Computer Security Problem?","created":"2023-07-20","cited_by_count":49},{"id":"2310.01152","title":"Large Language Model-Powered Smart Contract Vulnerability Detection: New Perspectives","created":"2023-10-02","cited_by_count":48},{"id":"2403.09675","title":"Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databases","created":"2024-02-05","cited_by_count":45},{"id":"2309.06057","title":"RAP-Gen: Retrieval-Augmented Patch Generation with CodeT5 for Automatic Program Repair","created":"2023-09-12","cited_by_count":44},{"id":"2305.14752","title":"A New Era in Software Security: Towards Self-Healing Software via Large Language Models and Formal Verification","created":"2023-05-24","cited_by_count":42},{"id":"2309.05520","title":"When ChatGPT Meets Smart Contract Vulnerability Detection: How Far Are We?","created":"2023-09-11","cited_by_count":42},{"id":"2204.03214","title":"Transformer-Based Language Models for Software Vulnerability Detection","created":"2022-04-07","cited_by_count":39},{"id":"2306.14263","title":"Revolutionizing Cyber Threat Detection with Large Language Models: A privacy-preserving BERT-based Lightweight Model for IoT/IIoT Devices","created":"2023-06-25","cited_by_count":39},{"id":"2404.11595","title":"A Deep Dive into Large Language Models for Automated Bug Localization and Repair","created":"2024-04-17","cited_by_count":39},{"id":"2304.02014","title":"Large Language Models are Edge-Case Fuzzers: Testing Deep Learning Libraries via FuzzGPT","created":"2023-04-04","cited_by_count":36},{"id":"2305.08005","title":"Beyond the Safeguards: Exploring the Security Risks of ChatGPT","created":"2023-05-13","cited_by_count":36},{"id":"2306.12338","title":"Do you still need a manual smart contract audit?","created":"2023-06-21","cited_by_count":35},{"id":"2307.02192","title":"The FormAI Dataset: Generative AI in Software Security Through the Lens of Formal Verification","created":"2023-07-05","cited_by_count":34},{"id":"2309.09435","title":"Security and Privacy on Generative Data in AIGC: A Survey","created":"2023-09-18","cited_by_count":34},{"id":"2402.00891","title":"Large Language Models in Cybersecurity: State-of-the-Art","created":"2024-01-30","cited_by_count":34},{"id":"1905.05965","title":"Autonomous Penetration Testing using Reinforcement Learning","created":"2019-05-15","cited_by_count":33},{"id":"2305.15336","title":"From Text to MITRE Techniques: Exploring the Malicious Use of Large Language Models for Generating Cyber Attack Payloads","created":"2023-05-24","cited_by_count":32},{"id":"2311.01677","title":"DialogBench: Evaluating LLMs as Human-like Dialogue Systems","created":"2023-11-03","cited_by_count":31},{"id":"2202.06649","title":"On the Importance of Building High-quality Training Datasets for Neural Code Search","created":"2022-02-14","cited_by_count":30},{"id":"2102.04351","title":"Generating Fake Cyber Threat Intelligence Using Transformer-Based Models","created":"2021-02-08","cited_by_count":29},{"id":"2209.15259","title":"On the Impossible Safety of Large AI Models","created":"2022-09-30","cited_by_count":28},{"id":"2305.12520","title":"SLaDe: A Portable Small Language Model Decompiler for Optimized Assembly","created":"2023-05-21","cited_by_count":28}],"next_cursor":"100"}