{"total":1057,"rows":[{"id":"2109.01652","title":"Finetuned Language Models Are Zero-Shot Learners","created":"2021-09-03","cited_by_count":3780,"area":null},{"id":"2205.01068","title":"OPT: Open Pre-trained Transformer Language Models","created":"2022-05-02","cited_by_count":3512,"area":null},{"id":"2206.07682","title":"Emergent Abilities of Large Language Models","created":"2022-06-15","cited_by_count":2512,"area":null},{"id":"2107.13586","title":"Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing","created":"2021-07-28","cited_by_count":2234,"area":null},{"id":"2102.09690","title":"Calibrate Before Use: Improving Few-Shot Performance of Language Models","created":"2021-02-19","cited_by_count":1392,"area":null},{"id":"2307.03109","title":"A Survey on Evaluation of Large Language Models","created":"2023-07-06","cited_by_count":1242,"area":null},{"id":"2101.06804","title":"What Makes Good In-Context Examples for GPT-$3$?","created":"2021-01-17","cited_by_count":1195,"area":null},{"id":"2104.08786","title":"Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity","created":"2021-04-18","cited_by_count":1135,"area":null},{"id":"2211.01910","title":"Large Language Models Are Human-Level Prompt Engineers","created":"2022-11-03","cited_by_count":1045,"area":null},{"id":"2209.11895","title":"In-context Learning and Induction Heads","created":"2022-09-24","cited_by_count":964,"area":null},{"id":"2111.02080","title":"An Explanation of In-context Learning as Implicit Bayesian Inference","created":"2021-11-03","cited_by_count":938,"area":null},{"id":"2205.05638","title":"Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning","created":"2022-05-11","cited_by_count":896,"area":null},{"id":"2309.03409","title":"Large Language Models as Optimizers","created":"2023-09-07","cited_by_count":864,"area":null},{"id":"2310.11324","title":"Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting","created":"2023-10-17","cited_by_count":817,"area":null},{"id":"2103.10385","title":"GPT Understands, Too","created":"2021-03-18","cited_by_count":716,"area":null},{"id":"2110.07602","title":"P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks","created":"2021-10-14","cited_by_count":689,"area":null},{"id":"2305.03495","title":"Automatic Prompt Optimization with \"Gradient Descent\" and Beam Search","created":"2023-05-04","cited_by_count":653,"area":null},{"id":"2102.07350","title":"Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm","created":"2021-02-15","cited_by_count":606,"area":null},{"id":"2104.08758","title":"Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus","created":"2021-04-18","cited_by_count":492,"area":null},{"id":"2111.01243","title":"Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey","created":"2021-11-01","cited_by_count":463,"area":null},{"id":"2203.09509","title":"ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection","created":"2022-03-17","cited_by_count":422,"area":null},{"id":"2102.02779","title":"Unifying Vision-and-Language Tasks via Text Generation","created":"2021-02-04","cited_by_count":412,"area":null},{"id":"2110.05679","title":"Large Language Models Can Be Strong Differentially Private Learners","created":"2021-10-12","cited_by_count":412,"area":null},{"id":"2203.13366","title":"Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)","created":"2022-03-24","cited_by_count":402,"area":null},{"id":"2205.12548","title":"RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning","created":"2022-05-25","cited_by_count":366,"area":null},{"id":"2305.17333","title":"Fine-Tuning Language Models with Just Forward Passes","created":"2023-05-27","cited_by_count":345,"area":null},{"id":"2105.11447","title":"True Few-Shot Learning with Language Models","created":"2021-05-24","cited_by_count":344,"area":null},{"id":"2109.01247","title":"Do Prompt-Based Models Really Understand the Meaning of their Prompts?","created":"2021-09-02","cited_by_count":326,"area":null},{"id":"2106.07139","title":"Pre-Trained Models: Past, Present and Future","created":"2021-06-14","cited_by_count":319,"area":null},{"id":"2211.11158","title":"Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification","created":"2022-11-21","cited_by_count":312,"area":null},{"id":"2112.04478","title":"Prompting Visual-Language Models for Efficient Video Understanding","created":"2021-12-08","cited_by_count":310,"area":null},{"id":"2104.05240","title":"Factual Probing Is [MASK]: Learning vs. Learning to Recall","created":"2021-04-12","cited_by_count":291,"area":null},{"id":"2406.11695","title":"Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programs","created":"2024-06-17","cited_by_count":291,"area":null},{"id":"2202.01279","title":"PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts","created":"2022-02-02","cited_by_count":289,"area":null},{"id":"2112.10668","title":"Few-shot Learning with Multilingual Language Models","created":"2021-12-20","cited_by_count":278,"area":null},{"id":"2203.17274","title":"Exploring Visual Prompts for Adapting Large-Scale Models","created":"2022-03-31","cited_by_count":274,"area":null},{"id":"2209.03320","title":"What does a platypus look like? Generating customized prompts for zero-shot image classification","created":"2022-09-07","cited_by_count":267,"area":null},{"id":"2104.08315","title":"Surface Form Competition: Why the Highest Probability Answer Isn't Always Right","created":"2021-04-16","cited_by_count":263,"area":null},{"id":"2201.03514","title":"Black-Box Tuning for Language-Model-as-a-Service","created":"2022-01-10","cited_by_count":256,"area":null},{"id":"2301.07069","title":"Prompting Large Language Model for Machine Translation: A Case Study","created":"2023-01-17","cited_by_count":250,"area":null},{"id":"2209.01975","title":"Selective Annotation Makes Language Models Better Few-Shot Learners","created":"2022-09-05","cited_by_count":243,"area":null},{"id":"2105.11259","title":"PTR: Prompt Tuning with Rules for Text Classification","created":"2021-05-24","cited_by_count":238,"area":null},{"id":"2110.07904","title":"SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer","created":"2021-10-15","cited_by_count":235,"area":null},{"id":"2209.11755","title":"Promptagator: Few-shot Dense Retrieval From 8 Examples","created":"2022-09-23","cited_by_count":235,"area":null},{"id":"2109.04332","title":"PPT: Pre-trained Prompt Tuning for Few-shot Learning","created":"2021-09-09","cited_by_count":232,"area":null},{"id":"2201.05966","title":"UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models","created":"2022-01-16","cited_by_count":231,"area":null},{"id":"2212.04037","title":"Demystifying Prompts in Language Models via Perplexity Estimation","created":"2022-12-08","cited_by_count":216,"area":null},{"id":"2203.15827","title":"LinkBERT: Pretraining Language Models with Document Links","created":"2022-03-29","cited_by_count":211,"area":null},{"id":"2212.10450","title":"Is GPT-3 a Good Data Annotator?","created":"2022-12-20","cited_by_count":208,"area":null},{"id":"2212.09611","title":"Optimizing Prompts for Text-to-Image Generation","created":"2022-12-19","cited_by_count":207,"area":null},{"id":"2302.10724","title":"ChatGPT: Jack of all trades, master of none","created":"2023-02-21","cited_by_count":204,"area":null},{"id":"2303.10158","title":"Data-centric Artificial Intelligence: A Survey","created":"2023-03-17","cited_by_count":203,"area":null},{"id":"2202.04538","title":"Generating Training Data with Language Models: Towards Zero-Shot Language Understanding","created":"2022-02-09","cited_by_count":199,"area":null},{"id":"2211.04486","title":"Active Example Selection for In-Context Learning","created":"2022-11-08","cited_by_count":196,"area":null},{"id":"2104.07540","title":"Generating Datasets with Pretrained Language Models","created":"2021-04-15","cited_by_count":193,"area":null},{"id":"2307.02046","title":"Recommender Systems in the Era of Large Language Models (LLMs)","created":"2023-07-05","cited_by_count":189,"area":null},{"id":"2108.02035","title":"Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification","created":"2021-08-04","cited_by_count":183,"area":null},{"id":"2305.13169","title":"A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity","created":"2023-05-22","cited_by_count":182,"area":null},{"id":"2104.07650","title":"KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extraction","created":"2021-04-15","cited_by_count":180,"area":null},{"id":"2203.06904","title":"Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models","created":"2022-03-14","cited_by_count":180,"area":null},{"id":"2311.04076","title":"Do LLMs exhibit human-like response biases? A case study in survey design","created":"2023-11-07","cited_by_count":180,"area":null},{"id":"2402.18013","title":"A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems","created":"2024-02-28","cited_by_count":170,"area":null},{"id":"2108.04106","title":"Noisy Channel Language Model Prompting for Few-Shot Text Classification","created":"2021-08-09","cited_by_count":165,"area":null},{"id":"2109.08668","title":"Primer: Searching for Efficient Transformers for Language Modeling","created":"2021-09-17","cited_by_count":164,"area":null},{"id":"2110.07814","title":"Meta-learning via Language Model In-context Tuning","created":"2021-10-15","cited_by_count":164,"area":null},{"id":"2104.08768","title":"Constrained Language Models Yield Few-Shot Semantic Parsers","created":"2021-04-18","cited_by_count":163,"area":null},{"id":"2205.06743","title":"A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities","created":"2022-05-13","cited_by_count":163,"area":null},{"id":"2110.07577","title":"UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning","created":"2021-10-14","cited_by_count":162,"area":null},{"id":"2212.10375","title":"Self-Adaptive In-Context Learning: An Information Compression Perspective for In-Context Example Selection and Ordering","created":"2022-12-20","cited_by_count":161,"area":null},{"id":"2204.06031","title":"A Review on Language Models as Knowledge Bases","created":"2022-04-12","cited_by_count":157,"area":null},{"id":"2201.11227","title":"Synchromesh: Reliable code generation from pre-trained language models","created":"2022-01-26","cited_by_count":156,"area":null},{"id":"2106.01760","title":"Template-Based Named Entity Recognition Using BART","created":"2021-06-03","cited_by_count":153,"area":null},{"id":"2303.02151","title":"Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners","created":"2023-03-03","cited_by_count":152,"area":null},{"id":"2111.01998","title":"OpenPrompt: An Open-source Framework for Prompt-learning","created":"2021-11-03","cited_by_count":148,"area":null},{"id":"2307.01504","title":"All in One: Multi-task Prompting for Graph Neural Networks","created":"2023-07-04","cited_by_count":148,"area":null},{"id":"2211.09102","title":"Prompting PaLM for Translation: Assessing Strategies and Performance","created":"2022-11-16","cited_by_count":145,"area":null},{"id":"2104.08835","title":"CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP","created":"2021-04-18","cited_by_count":142,"area":null},{"id":"2106.13353","title":"Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models","created":"2021-06-24","cited_by_count":139,"area":null},{"id":"2210.17451","title":"AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning","created":"2022-10-31","cited_by_count":137,"area":null},{"id":"2305.16938","title":"Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluation","created":"2023-05-26","cited_by_count":136,"area":null},{"id":"2208.11625","title":"PromptFL: Let Federated Participants Cooperatively Learn Prompts Instead of Models -- Federated Learning in Age of Foundation Model","created":"2022-08-24","cited_by_count":134,"area":null},{"id":"2108.05542","title":"AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing","created":"2021-08-12","cited_by_count":131,"area":null},{"id":"2302.13007","title":"AugGPT: Leveraging ChatGPT for Text Data Augmentation","created":"2023-02-25","cited_by_count":130,"area":null},{"id":"2201.05337","title":"A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models","created":"2022-01-14","cited_by_count":129,"area":null},{"id":"2104.04670","title":"Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections","created":"2021-04-10","cited_by_count":128,"area":null},{"id":"2203.07281","title":"GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models","created":"2022-03-14","cited_by_count":127,"area":null},{"id":"2405.06823","title":"PLeak: Prompt Leaking Attacks against Large Language Model Applications","created":"2024-05-10","cited_by_count":127,"area":null},{"id":"2102.08473","title":"COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining","created":"2021-02-16","cited_by_count":126,"area":null},{"id":"2112.01522","title":"Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks","created":"2021-12-02","cited_by_count":125,"area":null},{"id":"2204.11454","title":"Natural Language to Code Translation with Execution","created":"2022-04-25","cited_by_count":124,"area":null},{"id":"2104.14690","title":"Entailment as Few-Shot Learner","created":"2021-04-29","cited_by_count":123,"area":null},{"id":"2201.05273","title":"Pretrained Language Models for Text Generation: A Survey","created":"2022-01-14","cited_by_count":122,"area":null},{"id":"2210.05643","title":"A Kernel-Based View of Language Model Fine-Tuning","created":"2022-10-11","cited_by_count":121,"area":null},{"id":"2310.10378","title":"Cross-Lingual Consistency of Factual Knowledge in Multilingual Language Models","created":"2023-10-16","cited_by_count":118,"area":null},{"id":"2205.10747","title":"Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners","created":"2022-05-22","cited_by_count":117,"area":null},{"id":"2305.18248","title":"Do Language Models Know When They're Hallucinating References?","created":"2023-05-29","cited_by_count":116,"area":null},{"id":"2108.13161","title":"Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners","created":"2021-08-30","cited_by_count":115,"area":null},{"id":"2302.00861","title":"SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modeling","created":"2023-02-02","cited_by_count":115,"area":null},{"id":"2303.02861","title":"Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learning","created":"2023-03-06","cited_by_count":115,"area":null},{"id":"2402.11592","title":"Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark","created":"2024-02-18","cited_by_count":114,"area":null}],"next_cursor":"100"}