{"list":"other","total":63,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"2302.13971","title":"LLaMA: Open and Efficient Foundation Language Models","created":"2023-02-27","cited_by_count":14132},{"id":"2307.09288","title":"Llama 2: Open Foundation and Fine-Tuned Chat Models","created":"2023-07-18","cited_by_count":13028},{"id":"2204.02311","title":"PaLM: Scaling Language Modeling with Pathways","created":"2022-04-05","cited_by_count":5326},{"id":"1612.00796","title":"Overcoming catastrophic forgetting in neural networks","created":"2016-12-02","cited_by_count":4787},{"id":"1902.00751","title":"Parameter-Efficient Transfer Learning for NLP","created":"2019-02-02","cited_by_count":4236},{"id":"2101.00190","title":"Prefix-Tuning: Optimizing Continuous Prompts for Generation","created":"2021-01-01","cited_by_count":3915},{"id":"2104.08691","title":"The Power of Scale for Parameter-Efficient Prompt Tuning","created":"2021-04-18","cited_by_count":3795},{"id":"2109.01652","title":"Finetuned Language Models Are Zero-Shot Learners","created":"2021-09-03","cited_by_count":3780},{"id":"2205.01068","title":"OPT: Open Pre-trained Transformer Language Models","created":"2022-05-02","cited_by_count":3512},{"id":"2307.08691","title":"FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning","created":"2023-07-17","cited_by_count":2598},{"id":"1606.09282","title":"Learning without Forgetting","created":"2016-06-29","cited_by_count":2496},{"id":"1706.08840","title":"Gradient Episodic Memory for Continual Learning","created":"2017-06-26","cited_by_count":1898},{"id":"1606.04671","title":"Progressive Neural Networks","created":"2016-06-15","cited_by_count":1361},{"id":"1802.07569","title":"Continual Lifelong Learning with Neural Networks: A Review","created":"2018-02-21","cited_by_count":1330},{"id":"1409.1259","title":"On the Properties of Neural Machine Translation: Encoder-Decoder Approaches","created":"2014-09-03","cited_by_count":1304},{"id":"2106.10199","title":"BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models","created":"2021-06-18","cited_by_count":1245},{"id":"1702.03118","title":"Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning","created":"2017-02-10","cited_by_count":950},{"id":"2112.08654","title":"Learning to Prompt for Continual Learning","created":"2021-12-16","cited_by_count":944},{"id":"2302.00487","title":"A Comprehensive Survey of Continual Learning: Theory, Method and Application","created":"2023-01-31","cited_by_count":872},{"id":"2204.07705","title":"Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks","created":"2022-04-16","cited_by_count":868},{"id":"2403.14608","title":"Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey","created":"2024-03-21","cited_by_count":656},{"id":"2204.04799","title":"DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning","created":"2022-04-10","cited_by_count":642},{"id":"2308.08747","title":"An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning","created":"2023-08-17","cited_by_count":639},{"id":"2106.04647","title":"Compacter: Efficient Low-Rank Hypercomplex Adapter Layers","created":"2021-06-08","cited_by_count":460},{"id":"2211.13218","title":"CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learning","created":"2022-11-23","cited_by_count":450},{"id":"2103.09762","title":"Gradient Projection Memory for Continual Learning","created":"2021-03-17","cited_by_count":348},{"id":"2310.14152","title":"Orthogonal Subspace Learning for Language Model Continual Learning","created":"2023-10-22","cited_by_count":312},{"id":"1904.00310","title":"Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting","created":"2019-03-31","cited_by_count":302},{"id":"2207.12819","title":"S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learning","created":"2022-07-26","cited_by_count":246},{"id":"2404.16789","title":"Continual Learning of Large Language Models: A Comprehensive Survey","created":"2024-04-25","cited_by_count":234},{"id":"1910.06562","title":"Compacting, Picking and Growing for Unforgetting Continual Learning","created":"2019-10-15","cited_by_count":207},{"id":"2404.00228","title":"InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning","created":"2024-03-30","cited_by_count":198},{"id":"2301.12314","title":"Progressive Prompts: Continual Learning for Language Models","created":"2023-01-29","cited_by_count":197},{"id":"1906.01076","title":"Episodic Memory in Lifelong Language Learning","created":"2019-06-03","cited_by_count":188},{"id":"2303.05118","title":"SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Model","created":"2023-03-09","cited_by_count":180},{"id":"2307.02251","title":"RanPAC: Random Projections and Pre-trained Models for Continual Learning","created":"2023-07-05","cited_by_count":164},{"id":"1909.03329","title":"LAMOL: LAnguage MOdeling for Lifelong Language Learning","created":"2019-09-07","cited_by_count":160},{"id":"2103.07113","title":"Training Networks in Null Space of Feature Covariance for Continual Learning","created":"2021-03-12","cited_by_count":143},{"id":"2304.06027","title":"Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRA","created":"2023-04-12","cited_by_count":141},{"id":"2310.07234","title":"Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimality","created":"2023-10-11","cited_by_count":121},{"id":"2201.12604","title":"Learning Fast, Learning Slow: A General Continual Learning Method based on Complementary Learning System","created":"2022-01-29","cited_by_count":112},{"id":"2003.13726","title":"Continual Learning with Node-Importance based Adaptive Group Sparse Regularization","created":"2020-03-30","cited_by_count":105},{"id":"2110.07298","title":"LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5","created":"2021-10-14","cited_by_count":104},{"id":"2010.11635","title":"Continual Learning in Low-rank Orthogonal Subspaces","created":"2020-10-22","cited_by_count":99},{"id":"2310.06762","title":"TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models","created":"2023-10-10","cited_by_count":66},{"id":"2403.18886","title":"Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning","created":"2024-03-27","cited_by_count":53},{"id":"2405.14124","title":"Mixture of Experts Meets Prompt-Based Continual Learning","created":"2024-05-23","cited_by_count":43},{"id":"2401.08295","title":"SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models","created":"2024-01-16","cited_by_count":38},{"id":"2308.09303","title":"Online Class Incremental Learning on Stochastic Blurry Task Boundary via Mask and Visual Prompt Tuning","created":"2023-08-18","cited_by_count":35},{"id":"2203.15355","title":"Online Continual Learning on a Contaminated Data Stream with Blurry Task Boundaries","created":"2022-03-29","cited_by_count":31},{"id":"2205.00305","title":"AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NLP Tasks","created":"2022-04-30","cited_by_count":29},{"id":"2404.07470","title":"Scalable Language Model with Generalized Continual Learning","created":"2024-04-11","cited_by_count":28},{"id":"2406.17245","title":"Unlocking Continual Learning Abilities in Language Models","created":"2024-06-25","cited_by_count":23},{"id":"2211.09790","title":"ConStruct-VL: Data-Free Continual Structured VL Concepts Learning","created":"2022-11-17","cited_by_count":20},{"id":"2407.05229","title":"HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning","created":"2024-07-07","cited_by_count":20},{"id":"2408.09857","title":"TaSL: Continual Dialog State Tracking via Task Skill Localization and Consolidation","created":"2024-08-19","cited_by_count":18},{"id":"2411.02175","title":"SAFE: Slow and Fast Parameter-Efficient Tuning for Continual Learning with Pre-Trained Models","created":"2024-11-04","cited_by_count":18},{"id":"2411.06171","title":"SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models","created":"2024-11-09","cited_by_count":11},{"id":"2408.05200","title":"KIF: Knowledge Identification and Fusion for Language Model Continual Learning","created":"2024-08-09","cited_by_count":9}],"next_cursor":null}