{"list":"other","total":123,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"1710.09412","title":"mixup: Beyond Empirical Risk Minimization","created":"2017-10-25","cited_by_count":5183},{"id":"1703.03400","title":"Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks","created":"2017-03-09","cited_by_count":4897},{"id":"1910.01108","title":"DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter","created":"2019-10-02","cited_by_count":4307},{"id":"1902.00751","title":"Parameter-Efficient Transfer Learning for NLP","created":"2019-02-02","cited_by_count":4236},{"id":"2101.00190","title":"Prefix-Tuning: Optimizing Continuous Prompts for Generation","created":"2021-01-01","cited_by_count":3915},{"id":"2104.08691","title":"The Power of Scale for Parameter-Efficient Prompt Tuning","created":"2021-04-18","cited_by_count":3795},{"id":"1703.05175","title":"Prototypical Networks for Few-shot Learning","created":"2017-03-15","cited_by_count":3015},{"id":"1906.08237","title":"XLNet: Generalized Autoregressive Pretraining for Language Understanding","created":"2019-06-19","cited_by_count":2811},{"id":"1909.11942","title":"ALBERT: A Lite BERT for Self-supervised Learning of Language Representations","created":"2019-09-26","cited_by_count":2790},{"id":"1606.04080","title":"Matching Networks for One Shot Learning","created":"2016-06-13","cited_by_count":2255},{"id":"2107.13586","title":"Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing","created":"2021-07-28","cited_by_count":2234},{"id":"2102.09690","title":"Calibrate Before Use: Improving Few-Shot Performance of Language Models","created":"2021-02-19","cited_by_count":1392},{"id":"2012.15723","title":"Making Pre-trained Language Models Better Few-shot Learners","created":"2020-12-31","cited_by_count":1256},{"id":"2101.06804","title":"What Makes Good In-Context Examples for GPT-$3$?","created":"2021-01-17","cited_by_count":1195},{"id":"2104.08786","title":"Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity","created":"2021-04-18","cited_by_count":1135},{"id":"1803.02999","title":"On First-Order Meta-Learning Algorithms","created":"2018-03-08","cited_by_count":1018},{"id":"2004.05439","title":"Meta-Learning in Neural Networks: A Survey","created":"2020-04-11","cited_by_count":950},{"id":"2310.11324","title":"Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting","created":"2023-10-17","cited_by_count":817},{"id":"2002.12327","title":"A Primer in BERTology: What we know about how BERT works","created":"2020-02-27","cited_by_count":815},{"id":"2005.00247","title":"AdapterFusion: Non-Destructive Task Composition for Transfer Learning","created":"2020-05-01","cited_by_count":788},{"id":"2303.17548","title":"Whose Opinions Do Language Models Reflect?","created":"2023-03-30","cited_by_count":773},{"id":"2009.07118","title":"It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners","created":"2020-09-15","cited_by_count":669},{"id":"2305.03495","title":"Automatic Prompt Optimization with \"Gradient Descent\" and Beam Search","created":"2023-05-04","cited_by_count":653},{"id":"2112.08633","title":"Learning To Retrieve Prompts for In-Context Learning","created":"2021-12-16","cited_by_count":648},{"id":"2308.10792","title":"Instruction Tuning for Large Language Models: A Survey","created":"2023-08-21","cited_by_count":623},{"id":"2011.03395","title":"Underspecification Presents Challenges for Credibility in Modern Machine Learning","created":"2020-11-06","cited_by_count":496},{"id":"2309.03882","title":"Large Language Models Are Not Robust Multiple Choice Selectors","created":"2023-09-07","cited_by_count":486},{"id":"2002.06305","title":"Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping","created":"2020-02-15","cited_by_count":384},{"id":"1909.09157","title":"Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML","created":"2019-09-19","cited_by_count":359},{"id":"2105.11447","title":"True Few-Shot Learning with Language Models","created":"2021-05-24","cited_by_count":344},{"id":"2109.01247","title":"Do Prompt-Based Models Really Understand the Meaning of their Prompts?","created":"2021-09-02","cited_by_count":326},{"id":"1905.10018","title":"Momentum-Based Variance Reduction in Non-Convex SGD","created":"2019-05-24","cited_by_count":306},{"id":"2308.11483","title":"Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questions","created":"2023-08-22","cited_by_count":263},{"id":"2006.04884","title":"On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines","created":"2020-06-08","cited_by_count":255},{"id":"2301.07069","title":"Prompting Large Language Model for Machine Translation: A Case Study","created":"2023-01-17","cited_by_count":250},{"id":"2209.01975","title":"Selective Annotation Makes Language Models Better Few-Shot Learners","created":"2022-09-05","cited_by_count":243},{"id":"2006.05987","title":"Revisiting Few-sample BERT Fine-tuning","created":"2020-06-10","cited_by_count":238},{"id":"2110.07904","title":"SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer","created":"2021-10-15","cited_by_count":235},{"id":"2212.04037","title":"Demystifying Prompts in Language Models via Perplexity Estimation","created":"2022-12-08","cited_by_count":216},{"id":"1811.01088","title":"Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Tasks","created":"2018-11-02","cited_by_count":215},{"id":"2210.11466","title":"Surgical Fine-Tuning Improves Adaptation to Distribution Shifts","created":"2022-10-20","cited_by_count":205},{"id":"2103.03098","title":"Accounting for Variance in Machine Learning Benchmarks","created":"2021-03-01","cited_by_count":201},{"id":"2211.04486","title":"Active Example Selection for In-Context Learning","created":"2022-11-08","cited_by_count":196},{"id":"2212.02437","title":"In-context Examples Selection for Machine Translation","created":"2022-12-05","cited_by_count":172},{"id":"2205.06743","title":"A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities","created":"2022-05-13","cited_by_count":163},{"id":"2212.10375","title":"Self-Adaptive In-Context Learning: An Information Compression Perspective for In-Context Example Selection and Ordering","created":"2022-12-20","cited_by_count":161},{"id":"2302.10198","title":"Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT","created":"2023-02-19","cited_by_count":155},{"id":"2109.05687","title":"Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning","created":"2021-09-13","cited_by_count":146},{"id":"2110.07560","title":"Composable Sparse Fine-Tuning for Cross-Lingual Transfer","created":"2021-10-14","cited_by_count":144},{"id":"2302.05698","title":"Compositional Exemplars for In-context Learning","created":"2023-02-11","cited_by_count":144},{"id":"2104.08835","title":"CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP","created":"2021-04-18","cited_by_count":142},{"id":"2211.15583","title":"On the Effectiveness of Parameter-Efficient Fine-Tuning","created":"2022-11-28","cited_by_count":141},{"id":"2106.13353","title":"Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models","created":"2021-06-24","cited_by_count":139},{"id":"2107.07002","title":"The Benchmark Lottery","created":"2021-07-14","cited_by_count":136},{"id":"2305.16938","title":"Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluation","created":"2023-05-26","cited_by_count":136},{"id":"1310.0150","title":"Stability","created":"2013-10-01","cited_by_count":120},{"id":"2302.12822","title":"Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data","created":"2023-02-24","cited_by_count":119},{"id":"2303.08559","title":"Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!","created":"2023-03-15","cited_by_count":119},{"id":"2212.10773","title":"MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning","created":"2022-12-21","cited_by_count":109},{"id":"2302.13539","title":"Finding Support Examples for In-Context Learning","created":"2023-02-27","cited_by_count":104},{"id":"1910.13616","title":"Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation","created":"2019-10-30","cited_by_count":103},{"id":"2309.17249","title":"Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering","created":"2023-09-29","cited_by_count":94},{"id":"2106.16163","title":"The MultiBERTs: BERT Reproductions for Robustness Analysis","created":"2021-06-30","cited_by_count":92},{"id":"1911.02969","title":"BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performance","created":"2019-11-07","cited_by_count":89},{"id":"2203.11364","title":"An Information-theoretic Approach to Prompt Engineering Without Ground Truth Labels","created":"2022-03-21","cited_by_count":89},{"id":"2305.19148","title":"Mitigating Label Biases for In-context Learning","created":"2023-05-28","cited_by_count":89},{"id":"2202.07962","title":"Revisiting Parameter-Efficient Tuning: Are We Really There Yet?","created":"2022-02-16","cited_by_count":76},{"id":"2310.09881","title":"In-Context Learning with Iterative Demonstration Selection","created":"2023-10-15","cited_by_count":74},{"id":"1707.09861","title":"Reporting Score Distributions Makes a Difference: Performance Study of LSTM-networks for Sequence Tagging","created":"2017-07-31","cited_by_count":73},{"id":"2107.07170","title":"FLEX: Unifying Evaluation for Few-Shot NLP","created":"2021-07-15","cited_by_count":67},{"id":"2205.00049","title":"Prompt Consistency for Zero-Shot Task Generalization","created":"2022-04-29","cited_by_count":67},{"id":"2305.03937","title":"Residual Prompt Tuning: Improving Prompt Tuning with Residual Reparameterization","created":"2023-05-06","cited_by_count":64},{"id":"2302.11042","title":"In-context Example Selection with Influences","created":"2023-02-21","cited_by_count":61},{"id":"2106.11872","title":"Randomness In Neural Network Training: Characterizing The Impact of Tooling","created":"2021-06-22","cited_by_count":59},{"id":"2212.10378","title":"Data Curation Alone Can Stabilize In-context Learning","created":"2022-12-20","cited_by_count":59},{"id":"1911.03863","title":"Learning to Few-Shot Learn Across Diverse Natural Language Classification Tasks","created":"2019-11-10","cited_by_count":57},{"id":"2305.14264","title":"Active Learning Principles for In-Context Learning with Large Language Models","created":"2023-05-23","cited_by_count":54},{"id":"2106.01751","title":"Reordering Examples Helps during Priming-based Few-Shot Learning","created":"2021-06-03","cited_by_count":50},{"id":"2103.04514","title":"Nondeterminism and Instability in Neural Network Optimization","created":"2021-03-08","cited_by_count":48},{"id":"2305.14210","title":"Skill-Based Few-Shot Selection for In-Context Learning","created":"2023-05-23","cited_by_count":46},{"id":"2012.15682","title":"A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters","created":"2020-12-31","cited_by_count":45},{"id":"2202.12024","title":"NoisyTune: A Little Noise Can Help You Finetune Pretrained Language Models Better","created":"2022-02-24","cited_by_count":43},{"id":"2310.09748","title":"Large Language Model-Aware In-Context Learning for Code Generation","created":"2023-10-15","cited_by_count":43},{"id":"2302.06235","title":"A Simple Zero-shot Prompt Weighting Technique to Improve Prompt Ensembling in Text-Image Models","created":"2023-02-13","cited_by_count":39},{"id":"2310.20046","title":"Which Examples to Annotate for In-Context Learning? Towards Effective and Efficient Selection","created":"2023-10-30","cited_by_count":37},{"id":"2105.06020","title":"Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level","created":"2021-05-13","cited_by_count":34},{"id":"2310.13486","title":"Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learning","created":"2023-10-20","cited_by_count":31},{"id":"2107.04835","title":"Noise Stability Regularization for Improving BERT Fine-tuning","created":"2021-07-10","cited_by_count":29},{"id":"2010.00854","title":"Which *BERT? A Survey Organizing Contextualized Encoders","created":"2020-10-02","cited_by_count":26},{"id":"2107.03176","title":"On Training Instance Selection for Few-Shot Neural Text Generation","created":"2021-07-07","cited_by_count":26},{"id":"2205.01500","title":"Meta Learning for Natural Language Processing: A Survey","created":"2022-05-03","cited_by_count":26},{"id":"2305.08714","title":"Sensitivity and Robustness of Large Language Models to Prompt Template in Japanese Text Classification Tasks","created":"2023-05-15","cited_by_count":25},{"id":"2310.01651","title":"Fool Your (Vision and) Language Model With Embarrassingly Simple Permutations","created":"2023-10-02","cited_by_count":25},{"id":"2202.02326","title":"Towards Training Reproducible Deep Learning Models","created":"2022-02-04","cited_by_count":23},{"id":"2004.13606","title":"The Curse of Performance Instability in Analysis Datasets: Consequences, Source, and Suggestions","created":"2020-04-28","cited_by_count":22},{"id":"2211.02069","title":"LMentry: A Language Model Benchmark of Elementary Language Tasks","created":"2022-11-03","cited_by_count":22},{"id":"2310.13127","title":"Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models","created":"2023-10-19","cited_by_count":21},{"id":"2211.08358","title":"MEAL: Stable and Active Learning for Few-Shot Prompting","created":"2022-11-15","cited_by_count":20}],"next_cursor":"100"}