{"total":722,"rows":[{"id":"2102.12452","title":"Probing Classifiers: Promises, Shortcomings, and Advances","created":"2021-02-24","cited_by_count":876,"area":null},{"id":"2311.03658","title":"The Linear Representation Hypothesis and the Geometry of Large Language Models","created":"2023-11-07","cited_by_count":716,"area":null},{"id":"2111.01243","title":"Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey","created":"2021-11-01","cited_by_count":463,"area":null},{"id":"2104.06599","title":"Learning How to Ask: Querying LMs with Mixtures of Soft Prompts","created":"2021-04-14","cited_by_count":377,"area":null},{"id":"2102.01017","title":"Measuring and Improving Consistency in Pretrained Language Models","created":"2021-02-01","cited_by_count":364,"area":null},{"id":"2305.01610","title":"Finding Neurons in a Haystack: Case Studies with Sparse Probing","created":"2023-05-02","cited_by_count":334,"area":null},{"id":"2309.01029","title":"Explainability for Large Language Models: A Survey","created":"2023-09-02","cited_by_count":333,"area":null},{"id":"2306.05087","title":"PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimization","created":"2023-06-08","cited_by_count":316,"area":null},{"id":"2310.02207","title":"Language Models Represent Space and Time","created":"2023-10-03","cited_by_count":316,"area":null},{"id":"2104.05240","title":"Factual Probing Is [MASK]: Learning vs. Learning to Recall","created":"2021-04-12","cited_by_count":291,"area":null},{"id":"2403.08319","title":"Knowledge Conflicts for LLMs: A Survey","created":"2024-03-13","cited_by_count":283,"area":null},{"id":"2308.07633","title":"A Survey on Model Compression for Large Language Models","created":"2023-08-15","cited_by_count":269,"area":null},{"id":"2205.10643","title":"Self-Supervised Speech Representation Learning: A Review","created":"2022-05-21","cited_by_count":260,"area":null},{"id":"2301.04213","title":"Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Models","created":"2023-01-10","cited_by_count":243,"area":null},{"id":"2305.00586","title":"How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model","created":"2023-04-30","cited_by_count":202,"area":null},{"id":"2104.08671","title":"When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset","created":"2021-04-18","cited_by_count":201,"area":null},{"id":"2104.06644","title":"Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little","created":"2021-04-14","cited_by_count":177,"area":null},{"id":"2303.15647","title":"Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning","created":"2023-03-28","cited_by_count":173,"area":null},{"id":"2204.06031","title":"A Review on Language Models as Knowledge Bases","created":"2022-04-12","cited_by_count":157,"area":null},{"id":"2108.04840","title":"Post-hoc Interpretability for Neural NLP: A Survey","created":"2021-08-10","cited_by_count":156,"area":null},{"id":"2203.13722","title":"Probing Pre-Trained Language Models for Cross-Cultural Differences in Values","created":"2022-03-25","cited_by_count":149,"area":null},{"id":"2110.10090","title":"Inductive Biases and Variable Creation in Self-Attention Mechanisms","created":"2021-10-19","cited_by_count":144,"area":null},{"id":"2306.02896","title":"Representational Strengths and Limitations of Transformers","created":"2023-06-05","cited_by_count":133,"area":null},{"id":"2209.02535","title":"Analyzing Transformers in Embedding Space","created":"2022-09-06","cited_by_count":132,"area":null},{"id":"2303.11032","title":"DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4","created":"2023-03-20","cited_by_count":130,"area":null},{"id":"2111.09259","title":"Acquisition of Chess Knowledge in AlphaZero","created":"2021-11-17","cited_by_count":123,"area":null},{"id":"2105.06990","title":"BERT Busters: Outlier Dimensions that Disrupt Transformers","created":"2021-05-14","cited_by_count":112,"area":null},{"id":"2302.00294","title":"The geometry of hidden representations of large transformer models","created":"2023-02-01","cited_by_count":112,"area":null},{"id":"2309.01809","title":"Are Emergent Abilities in Large Language Models just In-Context Learning?","created":"2023-09-04","cited_by_count":109,"area":null},{"id":"2103.15949","title":"Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factors","created":"2021-03-29","cited_by_count":108,"area":null},{"id":"2310.17191","title":"How do Language Models Bind Entities in Context?","created":"2023-10-26","cited_by_count":108,"area":null},{"id":"2206.04301","title":"Unveiling Transformers with LEGO: a synthetic reasoning task","created":"2022-06-09","cited_by_count":106,"area":null},{"id":"2301.05062","title":"Tracr: Compiled Transformers as a Laboratory for Interpretability","created":"2023-01-12","cited_by_count":104,"area":null},{"id":"2305.08809","title":"Interpretability at Scale: Identifying Causal Mechanisms in Alpaca","created":"2023-05-15","cited_by_count":103,"area":null},{"id":"2208.07998","title":"What Artificial Neural Networks Can Tell Us About Human Language Acquisition","created":"2022-08-17","cited_by_count":99,"area":null},{"id":"2109.11377","title":"WRENCH: A Comprehensive Benchmark for Weak Supervision","created":"2021-09-23","cited_by_count":96,"area":null},{"id":"2106.16163","title":"The MultiBERTs: BERT Reproductions for Robustness Analysis","created":"2021-06-30","cited_by_count":92,"area":null},{"id":"2303.11504","title":"Language Model Behavior: A Comprehensive Survey","created":"2023-03-20","cited_by_count":92,"area":null},{"id":"2104.08027","title":"Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders","created":"2021-04-16","cited_by_count":88,"area":null},{"id":"2302.04181","title":"Attending to Graph Transformers","created":"2023-02-08","cited_by_count":83,"area":null},{"id":"2106.09226","title":"Why Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuning","created":"2021-06-17","cited_by_count":82,"area":null},{"id":"2111.13654","title":"Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs","created":"2021-11-26","cited_by_count":79,"area":null},{"id":"2103.13084","title":"Paragraph-level Rationale Extraction through Regularization: A case study on European Court of Human Rights Cases","created":"2021-03-24","cited_by_count":77,"area":null},{"id":"2202.06671","title":"Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings","created":"2022-02-14","cited_by_count":75,"area":null},{"id":"2109.04448","title":"Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers","created":"2021-09-09","cited_by_count":72,"area":null},{"id":"2210.16133","title":"Stop Measuring Calibration When Humans Disagree","created":"2022-10-28","cited_by_count":71,"area":null},{"id":"2310.09263","title":"Table-GPT: Table-tuned GPT for Diverse Table Tasks","created":"2023-10-13","cited_by_count":69,"area":null},{"id":"2110.01518","title":"Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics","created":"2021-10-04","cited_by_count":67,"area":null},{"id":"2107.05677","title":"Codified audio language modeling learns useful representations for music information retrieval","created":"2021-07-12","cited_by_count":64,"area":null},{"id":"2402.16061","title":"How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Study","created":"2024-02-25","cited_by_count":64,"area":null},{"id":"2109.09234","title":"Conditional probing: measuring usable information beyond a baseline","created":"2021-09-19","cited_by_count":62,"area":null},{"id":"2305.09863","title":"Explaining black box text modules in natural language with language models","created":"2023-05-17","cited_by_count":62,"area":null},{"id":"2109.07020","title":"Frequency Effects on Syntactic Rule Learning in Transformers","created":"2021-09-14","cited_by_count":59,"area":null},{"id":"2105.04949","title":"BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?","created":"2021-05-11","cited_by_count":56,"area":null},{"id":"2104.10809","title":"Provable Limitations of Acquiring Meaning from Ungrounded Form: What Will Future Language Models Understand?","created":"2021-04-22","cited_by_count":55,"area":null},{"id":"2104.15135","title":"Explanation-Based Human Debugging of NLP Models: A Survey","created":"2021-04-30","cited_by_count":53,"area":null},{"id":"2105.13947","title":"Changing the World by Changing the Data","created":"2021-05-28","cited_by_count":51,"area":null},{"id":"2109.07152","title":"Incorporating Residual and Normalization Layers into Analysis of Masked Language Models","created":"2021-09-15","cited_by_count":51,"area":null},{"id":"2104.03869","title":"Probing BERT in Hyperbolic Spaces","created":"2021-04-08","cited_by_count":50,"area":null},{"id":"2202.06840","title":"What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code","created":"2022-02-14","cited_by_count":50,"area":null},{"id":"2508.02087","title":"When Truth Is Overridden: Uncovering the Internal Origins of Sycophancy in Large Language Models","created":"2025-08-04","cited_by_count":50,"area":null},{"id":"2107.00676","title":"A Primer on Pretrained Multilingual Language Models","created":"2021-07-01","cited_by_count":49,"area":null},{"id":"2303.08117","title":"Do Transformers Parse while Predicting the Masked Word?","created":"2023-03-14","cited_by_count":48,"area":null},{"id":"2310.17230","title":"Codebook Features: Sparse and Discrete Interpretability for Neural Networks","created":"2023-10-26","cited_by_count":48,"area":null},{"id":"2310.20320","title":"Theory of Mind in Large Language Models: Examining Performance of 11 State-of-the-Art models vs. Children Aged 7-10 on Advanced Tests","created":"2023-10-31","cited_by_count":48,"area":null},{"id":"2101.11131","title":"CLiMP: A Benchmark for Chinese Language Model Evaluation","created":"2021-01-26","cited_by_count":46,"area":null},{"id":"2601.04480","title":"When Models Manipulate Manifolds: The Geometry of a Counting Task","created":"2026-01-08","cited_by_count":46,"area":null},{"id":"2110.06696","title":"Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinese","created":"2021-10-13","cited_by_count":45,"area":null},{"id":"2206.05282","title":"Learning to Estimate Shapley Values with Vision Transformers","created":"2022-06-10","cited_by_count":45,"area":null},{"id":"2109.14989","title":"Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations","created":"2021-09-30","cited_by_count":44,"area":null},{"id":"2201.09745","title":"Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Tasks","created":"2022-01-24","cited_by_count":42,"area":null},{"id":"2204.11073","title":"Grad-SAM: Explaining Transformers via Gradient Self-Attention Maps","created":"2022-04-23","cited_by_count":42,"area":null},{"id":"2306.02109","title":"Encoding Time-Series Explanations through Self-Supervised Model Behavior Consistency","created":"2023-06-03","cited_by_count":42,"area":null},{"id":"2101.11043","title":"Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT","created":"2021-01-26","cited_by_count":41,"area":null},{"id":"2110.02406","title":"Word Acquisition in Neural Language Models","created":"2021-10-05","cited_by_count":41,"area":null},{"id":"2106.02902","title":"BERTnesia: Investigating the capture and forgetting of knowledge in BERT","created":"2021-06-05","cited_by_count":40,"area":null},{"id":"2101.08133","title":"Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates","created":"2021-01-20","cited_by_count":39,"area":null},{"id":"2104.14694","title":"Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Senses","created":"2021-04-29","cited_by_count":39,"area":null},{"id":"2108.01250","title":"Your fairness may vary: Pretrained language model fairness in toxic text classification","created":"2021-08-03","cited_by_count":39,"area":null},{"id":"2204.03214","title":"Transformer-Based Language Models for Software Vulnerability Detection","created":"2022-04-07","cited_by_count":39,"area":null},{"id":"2303.09859","title":"Trained on 100 million words and still in shape: BERT meets British National Corpus","created":"2023-03-17","cited_by_count":39,"area":null},{"id":"2201.12438","title":"Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Survey","created":"2022-01-28","cited_by_count":38,"area":null},{"id":"2206.13289","title":"Analyzing Encoded Concepts in Transformer Language Models","created":"2022-06-27","cited_by_count":38,"area":null},{"id":"2210.06929","title":"On the Explainability of Natural Language Processing Deep Models","created":"2022-10-13","cited_by_count":38,"area":null},{"id":"2311.14975","title":"Eliminating Domain Bias for Federated Learning in Representation Space","created":"2023-11-25","cited_by_count":38,"area":null},{"id":"2104.01785","title":"Annotating Columns with Pre-trained Language Models","created":"2021-04-05","cited_by_count":37,"area":null},{"id":"2106.02736","title":"Exposing the Implicit Energy Networks behind Masked Language Models via Metropolis--Hastings","created":"2021-06-04","cited_by_count":37,"area":null},{"id":"2212.08094","title":"Joint processing of linguistic properties in brains and language models","created":"2022-12-15","cited_by_count":37,"area":null},{"id":"2305.18390","title":"Emergent Modularity in Pre-trained Transformers","created":"2023-05-28","cited_by_count":37,"area":null},{"id":"2108.11308","title":"What do pre-trained code models know about code?","created":"2021-08-25","cited_by_count":36,"area":null},{"id":"2206.02608","title":"What do tokens know about their characters and how do they know it?","created":"2022-06-06","cited_by_count":36,"area":null},{"id":"2310.04270","title":"A Comprehensive Evaluation of Large Language Models on Benchmark Biomedical Text Processing Tasks","created":"2023-10-06","cited_by_count":36,"area":null},{"id":"2110.06821","title":"Leveraging redundancy in attention with Reuse Transformers","created":"2021-10-13","cited_by_count":33,"area":null},{"id":"2302.00456","title":"Analyzing Feed-Forward Blocks in Transformers through the Lens of Attention Maps","created":"2023-02-01","cited_by_count":33,"area":null},{"id":"2105.00828","title":"Memorisation versus Generalisation in Pre-trained Language Models","created":"2021-04-16","cited_by_count":32,"area":null},{"id":"2305.13417","title":"VISIT: Visualizing and Interpreting the Semantic Information Flow of Transformers","created":"2023-05-22","cited_by_count":32,"area":null},{"id":"2310.16570","title":"Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models","created":"2023-10-25","cited_by_count":32,"area":null},{"id":"2104.05837","title":"Relational World Knowledge Representation in Contextual Language Models: A Review","created":"2021-04-12","cited_by_count":31,"area":null},{"id":"2105.13818","title":"Language Models Use Monotonicity to Assess NPI Licensing","created":"2021-05-28","cited_by_count":31,"area":null},{"id":"2108.01266","title":"More but Correct: Generating Diversified and Entity-revised Medical Response","created":"2021-08-03","cited_by_count":31,"area":null}],"next_cursor":"100"}