{"list":"other","total":68,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2203.11171","title":"Self-Consistency Improves Chain of Thought Reasoning in Language Models","created":"2022-03-21","cited_by_count":5708},{"id":"2108.07258","title":"On the Opportunities and Risks of Foundation Models","created":"2021-08-16","cited_by_count":4033},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"2307.15043","title":"Universal and Transferable Adversarial Attacks on Aligned Language Models","created":"2023-07-27","cited_by_count":3104},{"id":"2206.07682","title":"Emergent Abilities of Large Language Models","created":"2022-06-15","cited_by_count":2512},{"id":"2312.10997","title":"Retrieval-Augmented Generation for Large Language Models: A Survey","created":"2023-12-18","cited_by_count":2212},{"id":"2202.03629","title":"Survey of Hallucination in Natural Language Generation","created":"2022-02-08","cited_by_count":2075},{"id":"2206.04615","title":"Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models","created":"2022-06-09","cited_by_count":1998},{"id":"1909.01066","title":"Language Models as Knowledge Bases?","created":"2019-09-03","cited_by_count":1936},{"id":"1702.08608","title":"Towards A Rigorous Science of Interpretable Machine Learning","created":"2017-02-28","cited_by_count":1416},{"id":"2302.04023","title":"A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity","created":"2023-02-08","cited_by_count":894},{"id":"2005.00928","title":"Quantifying Attention Flow in Transformers","created":"2020-05-02","cited_by_count":775},{"id":"2301.00234","title":"A Survey on In-context Learning","created":"2022-12-31","cited_by_count":721},{"id":"1907.11932","title":"Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailment","created":"2019-07-27","cited_by_count":671},{"id":"2109.14084","title":"VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding","created":"2021-09-28","cited_by_count":602},{"id":"2311.17035","title":"Scalable Extraction of Training Data from (Production) Language Models","created":"2023-11-28","cited_by_count":434},{"id":"2308.05374","title":"Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment","created":"2023-08-10","cited_by_count":401},{"id":"2110.06500","title":"Differentially Private Fine-tuning of Language Models","created":"2021-10-13","cited_by_count":400},{"id":"2309.05922","title":"A Survey of Hallucination in Large Foundation Models","created":"2023-09-12","cited_by_count":368},{"id":"2402.00253","title":"A Survey on Hallucination in Large Vision-Language Models","created":"2024-02-01","cited_by_count":357},{"id":"2401.11817","title":"Hallucination is Inevitable: An Innate Limitation of Large Language Models","created":"2024-01-22","cited_by_count":332},{"id":"2404.16789","title":"Continual Learning of Large Language Models: A Comprehensive Survey","created":"2024-04-25","cited_by_count":234},{"id":"2312.00886","title":"Nash Learning from Human Feedback","created":"2023-12-01","cited_by_count":224},{"id":"2212.10559","title":"Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers","created":"2022-12-20","cited_by_count":204},{"id":"2211.04325","title":"Will we run out of data? Limits of LLM scaling based on human-generated data","created":"2022-10-26","cited_by_count":195},{"id":"2307.03576","title":"One Step of Gradient Descent is Provably the Optimal In-Context Learner with One Layer of Linear Self-Attention","created":"2023-07-07","cited_by_count":170},{"id":"2204.06031","title":"A Review on Language Models as Knowledge Bases","created":"2022-04-12","cited_by_count":157},{"id":"2305.13281","title":"LM vs LM: Detecting Factual Errors via Cross Examination","created":"2023-05-22","cited_by_count":156},{"id":"2106.03521","title":"RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Models","created":"2021-06-07","cited_by_count":149},{"id":"2305.19420","title":"What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalization","created":"2023-05-30","cited_by_count":118},{"id":"2402.14735","title":"How Transformers Learn Causal Structure with Gradient Descent","created":"2024-02-22","cited_by_count":118},{"id":"2307.15936","title":"A Theory for Emergence of Complex Skills in Language Models","created":"2023-07-29","cited_by_count":113},{"id":"2402.01761","title":"Rethinking Interpretability in the Era of Large Language Models","created":"2024-01-30","cited_by_count":111},{"id":"2012.13985","title":"Explaining NLP Models via Minimal Contrastive Editing (MiCE)","created":"2020-12-27","cited_by_count":106},{"id":"2207.10551","title":"Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?","created":"2022-07-21","cited_by_count":103},{"id":"2306.14111","title":"Is RLHF More Difficult than Standard RL?","created":"2023-06-25","cited_by_count":96},{"id":"2310.08391","title":"How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?","created":"2023-10-12","cited_by_count":96},{"id":"2308.10149","title":"A Survey on Fairness in Large Language Models","created":"2023-08-20","cited_by_count":95},{"id":"2308.16898","title":"Transformers as Support Vector Machines","created":"2023-08-31","cited_by_count":74},{"id":"2004.12254","title":"Privacy in Deep Learning: A Survey","created":"2020-04-25","cited_by_count":71},{"id":"1912.08957","title":"Optimization for deep learning: theory and algorithms","created":"2019-12-19","cited_by_count":70},{"id":"2305.18438","title":"Reinforcement Learning with Human Feedback: Learning Dynamic Choices via Pessimism","created":"2023-05-29","cited_by_count":69},{"id":"2110.07483","title":"On the Pitfalls of Analyzing Individual Neurons in Language Models","created":"2021-10-14","cited_by_count":62},{"id":"2310.00535","title":"JoMA: Demystifying Multilayer Transformers via JOint Dynamics of MLP and Attention","created":"2023-10-01","cited_by_count":52},{"id":"2401.12874","title":"From Understanding to Utilization: A Survey on Explainability for Large Language Models","created":"2024-01-23","cited_by_count":48},{"id":"2305.16157","title":"Training Data Extraction From Pre-trained Language Models: A Survey","created":"2023-05-25","cited_by_count":45},{"id":"2402.09401","title":"Reinforcement Learning from Human Feedback with Active Queries","created":"2024-02-14","cited_by_count":43},{"id":"2304.13276","title":"The Closeness of In-Context Learning and Weight Shifting for Softmax Regression","created":"2023-04-26","cited_by_count":41},{"id":"2308.03762","title":"GPT-4 Can't Reason","created":"2023-07-21","cited_by_count":40},{"id":"1906.09688","title":"Transfer of Machine Learning Fairness across Domains","created":"2019-06-24","cited_by_count":36},{"id":"1910.05276","title":"exBERT: A Visual Analysis Tool to Explore Learned Representations in Transformers Models","created":"2019-10-11","cited_by_count":33},{"id":"2104.01477","title":"Exploring the Role of BERT Token Representations to Explain Sentence Probing Results","created":"2021-04-03","cited_by_count":29},{"id":"2402.09236","title":"Learning Interpretable Concepts: Unifying Causal Representation Learning and Foundation Models","created":"2024-02-14","cited_by_count":29},{"id":"2206.00129","title":"Fairness Transferability Subject to Bounded Distribution Shift","created":"2022-05-31","cited_by_count":28},{"id":"2301.13323","title":"Fairness and Accuracy under Domain Generalization","created":"2023-01-30","cited_by_count":24},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20},{"id":"2007.09371","title":"Tighter Generalization Bounds for Iterative Differentially Private Learning Algorithms","created":"2020-07-18","cited_by_count":14},{"id":"2402.01889","title":"The Role of Foundation Models in Neuro-Symbolic Learning and Reasoning","created":"2024-02-02","cited_by_count":12},{"id":"2405.08707","title":"Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory","created":"2024-05-14","cited_by_count":12},{"id":"2206.01836","title":"Dimension Independent Generalization of DP-SGD for Overparameterized Smooth Convex Optimization","created":"2022-06-03","cited_by_count":9},{"id":"2305.02160","title":"Explaining Language Models' Predictions with High-Impact Concepts","created":"2023-05-03","cited_by_count":7},{"id":"1504.05800","title":"On the Generalization Properties of Differential Privacy","created":"2015-04-22","cited_by_count":5},{"id":"1911.00677","title":"Fairness Violations and Mitigation under Covariate Shift","created":"2019-11-02","cited_by_count":5},{"id":"2405.18194","title":"Delving into Differentially Private Transformer","created":"2024-05-28","cited_by_count":5},{"id":"2307.12926","title":"Contextual Bandits and Imitation Learning via Preference-Based Active Queries","created":"2023-07-24","cited_by_count":2},{"id":"2405.12617","title":"Quantifying Semantic Emergence in Language Models","created":"2024-05-21","cited_by_count":2},{"id":"2405.15115","title":"Towards Better Understanding of In-Context Learning Ability from In-Context Uncertainty Quantification","created":"2024-05-24","cited_by_count":2}],"next_cursor":null}