{"list":"other","total":82,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1912.01703","title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","created":"2019-12-03","cited_by_count":20305},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"2204.02311","title":"PaLM: Scaling Language Modeling with Pathways","created":"2022-04-05","cited_by_count":5326},{"id":"2412.15115","title":"Qwen2.5 Technical Report","created":"2024-12-19","cited_by_count":4942},{"id":"2104.09864","title":"RoFormer: Enhanced Transformer with Rotary Position Embedding","created":"2021-04-20","cited_by_count":4703},{"id":"1902.00751","title":"Parameter-Efficient Transfer Learning for NLP","created":"2019-02-02","cited_by_count":4236},{"id":"2101.00190","title":"Prefix-Tuning: Optimizing Continuous Prompts for Generation","created":"2021-01-01","cited_by_count":3915},{"id":"2104.08691","title":"The Power of Scale for Parameter-Efficient Prompt Tuning","created":"2021-04-18","cited_by_count":3795},{"id":"2205.14135","title":"FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness","created":"2022-05-27","cited_by_count":3673},{"id":"2205.01068","title":"OPT: Open Pre-trained Transformer Language Models","created":"2022-05-02","cited_by_count":3512},{"id":"2210.11416","title":"Scaling Instruction-Finetuned Language Models","created":"2022-10-20","cited_by_count":3024},{"id":"2309.17453","title":"Efficient Streaming Language Models with Attention Sinks","created":"2023-09-29","cited_by_count":2186},{"id":"2211.05100","title":"BLOOM: A 176B-Parameter Open-Access Multilingual Language Model","created":"2022-11-09","cited_by_count":1984},{"id":"1901.02860","title":"Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context","created":"2019-01-09","cited_by_count":1850},{"id":"1811.00937","title":"CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge","created":"2018-11-02","cited_by_count":1822},{"id":"1905.00537","title":"SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems","created":"2019-05-02","cited_by_count":1729},{"id":"2203.12119","title":"Visual Prompt Tuning","created":"2022-03-23","cited_by_count":1681},{"id":"2002.08155","title":"CodeBERT: A Pre-Trained Model for Programming and Natural Languages","created":"2020-02-19","cited_by_count":1310},{"id":"2012.15723","title":"Making Pre-trained Language Models Better Few-shot Learners","created":"2020-12-31","cited_by_count":1256},{"id":"2202.03286","title":"Red Teaming Language Models with Language Models","created":"2022-02-07","cited_by_count":1026},{"id":"1906.04341","title":"What Does BERT Look At? An Analysis of BERT's Attention","created":"2019-06-11","cited_by_count":1003},{"id":"2112.04359","title":"Ethical and social risks of harm from Language Models","created":"2021-12-08","cited_by_count":966},{"id":"2209.07858","title":"Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned","created":"2022-08-23","cited_by_count":729},{"id":"2110.07602","title":"P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks","created":"2021-10-14","cited_by_count":689},{"id":"1705.08045","title":"Learning multiple visual domains with residual adapters","created":"2017-05-22","cited_by_count":557},{"id":"1808.03314","title":"Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network","created":"2018-08-09","cited_by_count":420},{"id":"2302.03668","title":"Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery","created":"2023-02-07","cited_by_count":336},{"id":"2102.04159","title":"Deep Residual Learning in Spiking Neural Networks","created":"2021-02-08","cited_by_count":331},{"id":"2305.19466","title":"The Impact of Positional Encoding on Length Generalization in Transformers","created":"2023-05-31","cited_by_count":327},{"id":"2304.01933","title":"LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models","created":"2023-04-04","cited_by_count":324},{"id":"2111.02840","title":"Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models","created":"2021-11-04","cited_by_count":232},{"id":"2006.15595","title":"Rethinking Positional Encoding in Language Pre-training","created":"2020-06-28","cited_by_count":197},{"id":"2111.10952","title":"ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning","created":"2021-11-22","cited_by_count":161},{"id":"2302.08500","title":"Auditing large language models: a three-layered approach","created":"2023-02-16","cited_by_count":137},{"id":"2305.13661","title":"On the Risk of Misinformation Pollution with Large Language Models","created":"2023-05-23","cited_by_count":128},{"id":"2308.16137","title":"LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models","created":"2023-08-30","cited_by_count":124},{"id":"2304.02210","title":"Document-Level Machine Translation with Large Language Models","created":"2023-04-05","cited_by_count":90},{"id":"2106.09226","title":"Why Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuning","created":"2021-06-17","cited_by_count":82},{"id":"2202.07962","title":"Revisiting Parameter-Efficient Tuning: Are We Really There Yet?","created":"2022-02-16","cited_by_count":76},{"id":"2406.15765","title":"Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibration","created":"2024-06-22","cited_by_count":74},{"id":"2307.13770","title":"E^2VPT: An Effective and Efficient Approach for Visual Prompt Tuning","created":"2023-07-25","cited_by_count":70},{"id":"2409.03752","title":"Attention Heads of Large Language Models: A Survey","created":"2024-09-05","cited_by_count":67},{"id":"2112.08348","title":"Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts","created":"2021-12-15","cited_by_count":64},{"id":"2305.03937","title":"Residual Prompt Tuning: Improving Prompt Tuning with Residual Reparameterization","created":"2023-05-06","cited_by_count":64},{"id":"2010.04903","title":"What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding","created":"2020-10-10","cited_by_count":52},{"id":"2402.14875","title":"What's in a Name? Auditing Large Language Models for Race and Gender Bias","created":"2024-02-21","cited_by_count":51},{"id":"2306.03435","title":"On the Role of Attention in Prompt-tuning","created":"2023-06-06","cited_by_count":50},{"id":"2009.07053","title":"Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Models","created":"2020-09-03","cited_by_count":49},{"id":"2405.18781","title":"On the Role of Attention Masks and LayerNorm in Transformers","created":"2024-05-29","cited_by_count":48},{"id":"2502.01563","title":"Massive Values in Self-Attention Modules are the Key to Contextual Knowledge Understanding","created":"2025-02-03","cited_by_count":47},{"id":"2307.16867","title":"Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision Redundancy","created":"2023-07-31","cited_by_count":44},{"id":"2204.04497","title":"IDPG: An Instance-Dependent Prompt Generation Method","created":"2022-04-09","cited_by_count":43},{"id":"1902.09243","title":"Pretraining-Based Natural Language Generation for Text Summarization","created":"2019-02-25","cited_by_count":40},{"id":"2402.04161","title":"Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains","created":"2024-02-06","cited_by_count":40},{"id":"2403.16187","title":"ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Models","created":"2024-03-24","cited_by_count":36},{"id":"2406.10737","title":"DPCore: Dynamic Prompt Coreset for Continual Test-Time Adaptation","created":"2024-06-15","cited_by_count":33},{"id":"2401.12902","title":"Facing the Elephant in the Room: Visual Prompt Tuning or Full Finetuning?","created":"2024-01-23","cited_by_count":31},{"id":"2210.04457","title":"XPrompt: Exploring the Extreme of Prompt Tuning","created":"2022-10-10","cited_by_count":30},{"id":"2305.18787","title":"Universality and Limitations of Prompt Tuning","created":"2023-05-30","cited_by_count":30},{"id":"2306.04933","title":"InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding","created":"2023-06-08","cited_by_count":30},{"id":"2411.01327","title":"Visual Fourier Prompt Tuning","created":"2024-11-02","cited_by_count":30},{"id":"2507.07796","title":"Visual Instance-aware Prompt Tuning","created":"2025-07-10","cited_by_count":29},{"id":"2402.01935","title":"Code Representation Learning At Scale","created":"2024-02-02","cited_by_count":26},{"id":"2406.07081","title":"Efficiently Exploring Large Language Models for Document-Level Machine Translation with In-context Learning","created":"2024-06-11","cited_by_count":23},{"id":"2405.11724","title":"Token-wise Influential Training Data Retrieval for Large Language Models","created":"2024-05-20","cited_by_count":20},{"id":"2407.09498","title":"OT-VP: Optimal Transport-guided Visual Prompting for Test-Time Adaptation","created":"2024-06-12","cited_by_count":17},{"id":"2409.15657","title":"M$^2$PT: Multimodal Prompt Tuning for Zero-shot Instruction Learning","created":"2024-09-24","cited_by_count":16},{"id":"2503.00723","title":"Re-Imagining Multimodal Instruction Tuning: A Representation View","created":"2025-03-02","cited_by_count":9},{"id":"2405.15282","title":"Prompt Tuning Strikes Back: Customizing Foundation Models with Low-Rank Prompt Adaptation","created":"2024-05-24","cited_by_count":8},{"id":"2503.01052","title":"ALinFiK: Learning to Approximate Linearized Future Influence Kernel for Scalable Third-Party LLM Data Valuation","created":"2025-03-02","cited_by_count":7},{"id":"2505.13439","title":"VTBench: Evaluating Visual Tokenizers for Autoregressive Image Generation","created":"2025-05-19","cited_by_count":6},{"id":"2509.00996","title":"MEPT: Mixture of Expert Prompt Tuning as a Manifold Mapper","created":"2025-08-31","cited_by_count":5},{"id":"2403.16447","title":"A Study on How Attention Scores in the BERT Model are Aware of Lexical Categories in Syntactic and Semantic Tasks on the GLUE Benchmark","created":"2024-03-25","cited_by_count":3},{"id":"2410.11020","title":"Improving the Language Understanding Capabilities of Large Language Models Using Reinforcement Learning","created":"2024-10-14","cited_by_count":3},{"id":"2502.12200","title":"Efficient and Effective Prompt Tuning via Prompt Decomposition and Compressed Outer Product","created":"2025-02-16","cited_by_count":3},{"id":"2406.05279","title":"SuperPos-Prompt: Enhancing Soft Prompt Tuning of Language Models with Superposition of Multi Token Embeddings","created":"2024-06-07","cited_by_count":2}],"next_cursor":null}