{"total":339,"rows":[{"id":"2102.12452","title":"Probing Classifiers: Promises, Shortcomings, and Advances","created":"2021-02-24","cited_by_count":876,"area":null},{"id":"2106.07139","title":"Pre-Trained Models: Past, Present and Future","created":"2021-06-14","cited_by_count":319,"area":null},{"id":"2502.02013","title":"Layer by Layer: Uncovering Hidden Representations in Language Models","created":"2025-02-04","cited_by_count":311,"area":null},{"id":"2110.07904","title":"SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer","created":"2021-10-15","cited_by_count":235,"area":null},{"id":"2210.12353","title":"Leveraging Large Language Models for Multiple Choice Question Answering","created":"2022-10-22","cited_by_count":203,"area":null},{"id":"2102.10407","title":"VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioning","created":"2021-02-20","cited_by_count":191,"area":null},{"id":"2401.01286","title":"A Comprehensive Study of Knowledge Editing for Large Language Models","created":"2024-01-02","cited_by_count":163,"area":null},{"id":"2109.04404","title":"All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality","created":"2021-09-09","cited_by_count":156,"area":null},{"id":"2106.06087","title":"Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models","created":"2021-06-10","cited_by_count":131,"area":null},{"id":"2103.06678","title":"The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models","created":"2021-03-11","cited_by_count":119,"area":null},{"id":"2302.00294","title":"The geometry of hidden representations of large transformer models","created":"2023-02-01","cited_by_count":112,"area":null},{"id":"2103.15949","title":"Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factors","created":"2021-03-29","cited_by_count":108,"area":null},{"id":"2106.09231","title":"Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases","created":"2021-06-17","cited_by_count":107,"area":null},{"id":"2303.09435","title":"Jump to Conclusions: Short-Cutting Transformers With Linear Transformations","created":"2023-03-16","cited_by_count":90,"area":null},{"id":"2203.11364","title":"An Information-theoretic Approach to Prompt Engineering Without Ground Truth Labels","created":"2022-03-21","cited_by_count":89,"area":null},{"id":"2309.04827","title":"Neurons in Large Language Models: Dead, N-gram, Positional","created":"2023-09-09","cited_by_count":88,"area":null},{"id":"2108.13138","title":"Neuron-level Interpretation of Deep NLP Models: A Survey","created":"2021-08-30","cited_by_count":81,"area":null},{"id":"2211.05994","title":"A Survey of Knowledge Enhanced Pre-trained Language Models","created":"2022-11-11","cited_by_count":76,"area":null},{"id":"2111.06719","title":"On Transferability of Prompt Tuning for Natural Language Processing","created":"2021-11-12","cited_by_count":75,"area":null},{"id":"2104.07885","title":"Probing Across Time: What Does RoBERTa Know and When?","created":"2021-04-16","cited_by_count":73,"area":null},{"id":"2211.07349","title":"Finding Skill Neurons in Pre-trained Transformer-based Language Models","created":"2022-11-14","cited_by_count":66,"area":null},{"id":"2107.05677","title":"Codified audio language modeling learns useful representations for music information retrieval","created":"2021-07-12","cited_by_count":64,"area":null},{"id":"2104.08247","title":"What to Pre-Train on? Efficient Intermediate Task Selection","created":"2021-04-16","cited_by_count":63,"area":null},{"id":"2205.07237","title":"Discovering Latent Concepts Learned in BERT","created":"2022-05-15","cited_by_count":56,"area":null},{"id":"2206.08657","title":"BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning","created":"2022-06-17","cited_by_count":56,"area":null},{"id":"2205.11380","title":"Outliers Dimensions that Disrupt Transformers Are Driven by Frequency","created":"2022-05-23","cited_by_count":55,"area":null},{"id":"2203.17247","title":"VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers","created":"2022-03-30","cited_by_count":53,"area":null},{"id":"2202.06840","title":"What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code","created":"2022-02-14","cited_by_count":50,"area":null},{"id":"2108.06130","title":"Semantic Answer Similarity for Evaluating Question Answering Models","created":"2021-08-13","cited_by_count":47,"area":null},{"id":"2403.08946","title":"Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era","created":"2024-03-13","cited_by_count":46,"area":null},{"id":"2203.04640","title":"Memory Efficient Continual Learning with Transformers","created":"2022-03-09","cited_by_count":43,"area":null},{"id":"2106.14282","title":"A Closer Look at How Fine-tuning Changes BERT","created":"2021-06-27","cited_by_count":42,"area":null},{"id":"2101.11043","title":"Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT","created":"2021-01-26","cited_by_count":41,"area":null},{"id":"2203.00633","title":"Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale","created":"2022-03-01","cited_by_count":41,"area":null},{"id":"2203.08075","title":"Things not Written in Text: Exploring Spatial Commonsense from Visual Signals","created":"2022-03-15","cited_by_count":41,"area":null},{"id":"2105.07109","title":"The Low-Dimensional Linear Geometry of Contextualized Word Representations","created":"2021-05-15","cited_by_count":40,"area":null},{"id":"2106.02902","title":"BERTnesia: Investigating the capture and forgetting of knowledge in BERT","created":"2021-06-05","cited_by_count":40,"area":null},{"id":"2105.14002","title":"What if This Modified That? Syntactic Interventions via Counterfactual Embeddings","created":"2021-05-28","cited_by_count":39,"area":null},{"id":"2211.07830","title":"Prompting Language Models for Linguistic Structure","created":"2022-11-15","cited_by_count":39,"area":null},{"id":"2108.12463","title":"Automatic Text Evaluation through the Lens of Wasserstein Barycenters","created":"2021-08-27","cited_by_count":38,"area":null},{"id":"2206.13289","title":"Analyzing Encoded Concepts in Transformer Language Models","created":"2022-06-27","cited_by_count":38,"area":null},{"id":"2305.18390","title":"Emergent Modularity in Pre-trained Transformers","created":"2023-05-28","cited_by_count":37,"area":null},{"id":"2412.09563","title":"Does Representation Matter? Exploring Intermediate Layers in Large Language Models","created":"2024-12-12","cited_by_count":34,"area":null},{"id":"2110.08455","title":"Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey","created":"2021-10-16","cited_by_count":33,"area":null},{"id":"2105.15179","title":"How transfer learning impacts linguistic knowledge in deep NLP models?","created":"2021-05-31","cited_by_count":32,"area":null},{"id":"2109.06939","title":"The Stem Cell Hypothesis: Dilemma behind Multi-Task Learning with Transformer Encoders","created":"2021-09-14","cited_by_count":32,"area":null},{"id":"2205.11758","title":"Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models","created":"2022-05-24","cited_by_count":32,"area":null},{"id":"2103.11072","title":"Local Interpretations for Explainable Natural Language Processing: A Survey","created":"2021-03-20","cited_by_count":31,"area":null},{"id":"2109.08406","title":"Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers","created":"2021-09-17","cited_by_count":30,"area":null},{"id":"2206.14017","title":"Proton: Probing Schema Linking Information from Pre-trained Language Models for Text-to-SQL Parsing","created":"2022-06-28","cited_by_count":30,"area":null},{"id":"2312.01429","title":"Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars","created":"2023-12-03","cited_by_count":30,"area":null},{"id":"2104.01477","title":"Exploring the Role of BERT Token Representations to Explain Sentence Probing Results","created":"2021-04-03","cited_by_count":29,"area":null},{"id":"2205.00305","title":"AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NLP Tasks","created":"2022-04-30","cited_by_count":29,"area":null},{"id":"2109.10540","title":"Awakening Latent Grounding from Pretrained Language Models for Semantic Parsing","created":"2021-09-22","cited_by_count":28,"area":null},{"id":"2104.12465","title":"GPT2MVS: Generative Pre-trained Transformer-2 for Multi-modal Video Summarization","created":"2021-04-26","cited_by_count":26,"area":null},{"id":"2210.14102","title":"Exploring Mode Connectivity for Pre-trained Language Models","created":"2022-10-25","cited_by_count":26,"area":null},{"id":"2104.05904","title":"DirectProbe: Studying Representations without Classifiers","created":"2021-04-13","cited_by_count":25,"area":null},{"id":"2202.12246","title":"Neural reality of argument structure constructions","created":"2022-02-24","cited_by_count":25,"area":null},{"id":"2201.09680","title":"Relational Memory Augmented Language Models","created":"2022-01-24","cited_by_count":24,"area":null},{"id":"2109.04740","title":"How Does Fine-tuning Affect the Geometry of Embedding Space: A Case Study on Isotropy","created":"2021-09-10","cited_by_count":23,"area":null},{"id":"2303.07616","title":"The Life Cycle of Knowledge in Big Language Models: A Survey","created":"2023-03-14","cited_by_count":23,"area":null},{"id":"2106.04262","title":"Question Generation for Adaptive Education","created":"2021-06-08","cited_by_count":22,"area":null},{"id":"2205.01543","title":"Learning to Transfer Prompts for Text Generation","created":"2022-05-03","cited_by_count":22,"area":null},{"id":"2206.08005","title":"Evaluating Self-Supervised Learning for Molecular Graph Embeddings","created":"2022-06-16","cited_by_count":22,"area":null},{"id":"2109.03160","title":"How much pretraining data do language models need to learn syntax?","created":"2021-09-07","cited_by_count":21,"area":null},{"id":"2206.13288","title":"Discovering Salient Neurons in Deep NLP Models","created":"2022-06-27","cited_by_count":21,"area":null},{"id":"2211.03495","title":"How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers","created":"2022-11-07","cited_by_count":21,"area":null},{"id":"2211.04079","title":"COPEN: Probing Conceptual Knowledge in Pre-trained Language Models","created":"2022-11-08","cited_by_count":21,"area":null},{"id":"2312.04333","title":"Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers","created":"2023-12-07","cited_by_count":20,"area":null},{"id":"2406.04289","title":"What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages","created":"2024-06-06","cited_by_count":20,"area":null},{"id":"2505.18132","title":"BiggerGait: Unlocking Gait Recognition with Layer-wise Representations from Large Vision Models","created":"2025-05-23","cited_by_count":20,"area":null},{"id":"2106.07935","title":"BERT Embeddings for Automatic Readability Assessment","created":"2021-06-15","cited_by_count":19,"area":null},{"id":"2210.12696","title":"On the Transformation of Latent Space in Fine-Tuned NLP Models","created":"2022-10-23","cited_by_count":19,"area":null},{"id":"2305.14057","title":"Can Language Models Understand Physical Concepts?","created":"2023-05-23","cited_by_count":19,"area":null},{"id":"2104.05694","title":"On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies","created":"2021-04-12","cited_by_count":18,"area":null},{"id":"2104.08197","title":"Probing artificial neural networks: insights from neuroscience","created":"2021-04-16","cited_by_count":17,"area":null},{"id":"2105.12449","title":"LMMS Reloaded: Transformer-based Sense Embeddings for Disambiguation and Beyond","created":"2021-05-26","cited_by_count":17,"area":null},{"id":"2510.00296","title":"Beyond Token Probes: Hallucination Detection via Activation Tensors with ACT-ViT","created":"2025-09-30","cited_by_count":17,"area":null},{"id":"2104.12471","title":"Contextualized Keyword Representations for Multi-modal Retinal Image Captioning","created":"2021-04-26","cited_by_count":16,"area":null},{"id":"2109.05958","title":"Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representations","created":"2021-09-13","cited_by_count":16,"area":null},{"id":"2203.10415","title":"How does the pre-training objective affect what large language models learn about linguistic properties?","created":"2022-03-20","cited_by_count":16,"area":null},{"id":"2305.13386","title":"Can LLMs facilitate interpretation of pre-trained language models?","created":"2023-05-22","cited_by_count":16,"area":null},{"id":"2310.03084","title":"Discovering Knowledge-Critical Subnetworks in Pretrained Language Models","created":"2023-10-04","cited_by_count":16,"area":null},{"id":"2101.09115","title":"The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT","created":"2021-01-22","cited_by_count":15,"area":null},{"id":"2104.07505","title":"Quantifying Gender Bias Towards Politicians in Cross-Lingual Language Models","created":"2021-04-15","cited_by_count":15,"area":null},{"id":"2210.16771","title":"Parameter-Efficient Tuning Makes a Good Classification Head","created":"2022-10-30","cited_by_count":15,"area":null},{"id":"2305.16765","title":"Backpack Language Models","created":"2023-05-26","cited_by_count":15,"area":null},{"id":"2306.13041","title":"Towards Explainable Evaluation Metrics for Machine Translation","created":"2023-06-22","cited_by_count":15,"area":null},{"id":"2402.16998","title":"What Do Language Models Hear? Probing for Auditory Representations in Language Models","created":"2024-02-26","cited_by_count":15,"area":null},{"id":"2408.13442","title":"A Law of Next-Token Prediction in Large Language Models","created":"2024-08-24","cited_by_count":15,"area":null},{"id":"2409.03662","title":"The representation landscape of few-shot learning and fine-tuning in large language models","created":"2024-09-05","cited_by_count":15,"area":null},{"id":"2104.07578","title":"Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models","created":"2021-04-15","cited_by_count":14,"area":null},{"id":"2204.06201","title":"Probing for Constituency Structure in Neural Language Models","created":"2022-04-13","cited_by_count":14,"area":null},{"id":"2302.03508","title":"Cluster-Level Contrastive Learning for Emotion Recognition in Conversations","created":"2023-02-07","cited_by_count":14,"area":null},{"id":"2306.08193","title":"Operationalising Representation in Natural Language Processing","created":"2023-06-14","cited_by_count":14,"area":null},{"id":"2401.14440","title":"Semantic Sensitivities and Inconsistent Predictions: Measuring the Fragility of NLI Models","created":"2024-01-25","cited_by_count":14,"area":null},{"id":"2406.10868","title":"Identifying Query-Relevant Neurons in Large Language Models for Long-Form Texts","created":"2024-06-16","cited_by_count":14,"area":null},{"id":"2410.11627","title":"Tokenization and Morphology in Multilingual Language Models: A Comparative Analysis of mT5 and ByT5","created":"2024-10-15","cited_by_count":14,"area":null},{"id":"2101.10726","title":"Regulatory Compliance through Doc2Doc Information Retrieval: A case study in EU/UK legislation where text similarity has limitations","created":"2021-01-26","cited_by_count":13,"area":null},{"id":"2203.08452","title":"Can Pre-trained Language Models Interpret Similes as Smart as Human?","created":"2022-03-16","cited_by_count":13,"area":null}],"next_cursor":"100"}