{"total":132,"rows":[{"id":"2208.07339","title":"LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale","created":"2022-08-15","cited_by_count":906,"area":null},{"id":"2306.11695","title":"A Simple and Effective Pruning Approach for Large Language Models","created":"2023-06-20","cited_by_count":800,"area":null},{"id":"2402.17762","title":"Massive Activations in Large Language Models","created":"2024-02-27","cited_by_count":294,"area":null},{"id":"2306.03819","title":"LEACE: Perfect linear concept erasure in closed form","created":"2023-06-06","cited_by_count":267,"area":null},{"id":"2212.09720","title":"The case for 4-bit precision: k-bit Inference Scaling Laws","created":"2022-12-19","cited_by_count":251,"area":null},{"id":"2310.05175","title":"Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity","created":"2023-10-08","cited_by_count":165,"area":null},{"id":"2305.06329","title":"Similarity of Neural Network Models: A Survey of Functional and Representational Measures","created":"2023-05-10","cited_by_count":131,"area":null},{"id":"2203.04212","title":"Measuring the Mixing of Contextual Information in the Transformer","created":"2022-03-08","cited_by_count":65,"area":null},{"id":"2403.05973","title":"Calibrating Large Language Models Using Their Generations Only","created":"2024-03-09","cited_by_count":65,"area":null},{"id":"2205.11380","title":"Outliers Dimensions that Disrupt Transformers Are Driven by Frequency","created":"2022-05-23","cited_by_count":55,"area":null},{"id":"2205.05092","title":"Problems with Cosine as a Measure of Embedding Similarity for High Frequency Words","created":"2022-05-10","cited_by_count":49,"area":null},{"id":"2301.12971","title":"Quantifying Context Mixing in Transformers","created":"2023-01-30","cited_by_count":43,"area":null},{"id":"2410.17413","title":"Scalable Influence and Fact Tracing for Large Language Model Pretraining","created":"2024-10-22","cited_by_count":42,"area":null},{"id":"2406.12016","title":"Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantization","created":"2024-06-17","cited_by_count":33,"area":null},{"id":"2305.13417","title":"VISIT: Visualizing and Interpreting the Semantic Information Flow of Transformers","created":"2023-05-22","cited_by_count":32,"area":null},{"id":"2110.04504","title":"An Isotropy Analysis in the Multilingual BERT Embedding Space","created":"2021-10-09","cited_by_count":25,"area":null},{"id":"2202.12246","title":"Neural reality of argument structure constructions","created":"2022-02-24","cited_by_count":25,"area":null},{"id":"2408.15417","title":"Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representations","created":"2024-08-27","cited_by_count":24,"area":null},{"id":"2405.14428","title":"Mitigating Quantization Errors Due to Activation Spikes in GLU-Based LLMs","created":"2024-05-23","cited_by_count":21,"area":null},{"id":"2206.03529","title":"How to Dissect a Muppet: The Structure of Transformer Embedding Spaces","created":"2022-06-07","cited_by_count":20,"area":null},{"id":"2307.03360","title":"Evaluating Biased Attitude Associations of Language Models in an Intersectional Context","created":"2023-07-07","cited_by_count":20,"area":null},{"id":"2305.13175","title":"Discovering Universal Geometry in Embeddings with ICA","created":"2023-05-22","cited_by_count":19,"area":null},{"id":"2305.17446","title":"Fine-tuning Happens in Tiny Subspaces: Exploring Intrinsic Task-specific Subspaces of Pre-trained Language Models","created":"2023-05-27","cited_by_count":19,"area":null},{"id":"2408.00531","title":"ReSi: A Comprehensive Benchmark for Representational Similarity Measures","created":"2024-08-01","cited_by_count":19,"area":null},{"id":"2205.13858","title":"Semeval-2022 Task 1: CODWOE -- Comparing Dictionaries and Word Embeddings","created":"2022-05-27","cited_by_count":18,"area":null},{"id":"2410.08113","title":"Robust AI-Generated Text Detection by Restricted Embeddings","created":"2024-10-10","cited_by_count":18,"area":null},{"id":"2306.00458","title":"Exploring Anisotropy and Outliers in Multilingual Language Models for Cross-Lingual Semantic Sentence Similarity","created":"2023-06-01","cited_by_count":17,"area":null},{"id":"2410.01444","title":"Geometric Signatures of Compositionality Across a Language Model's Lifetime","created":"2024-10-02","cited_by_count":16,"area":null},{"id":"2212.09170","title":"On Isotropy, Contextualization and Learning Dynamics of Contrastive-based Sentence Representation Learning","created":"2022-12-18","cited_by_count":15,"area":null},{"id":"2305.11550","title":"Viewing Knowledge Transfer in Multilingual Machine Translation Through a Representational Lens","created":"2023-05-19","cited_by_count":15,"area":null},{"id":"2310.17715","title":"Outlier Dimensions Encode Task-Specific Knowledge","created":"2023-10-26","cited_by_count":15,"area":null},{"id":"2409.03662","title":"The representation landscape of few-shot learning and fine-tuning in large language models","created":"2024-09-05","cited_by_count":15,"area":null},{"id":"2203.07511","title":"Contrastive Visual Semantic Pretraining Magnifies the Semantics of Natural Language Representations","created":"2022-03-14","cited_by_count":14,"area":null},{"id":"2406.09200","title":"Orthogonality and isotropy of speaker and phonetic information in self-supervised speech representations","created":"2024-06-13","cited_by_count":14,"area":null},{"id":"2311.04900","title":"How Abstract Is Linguistic Generalization in Large Language Models? Experiments with Argument Structure","created":"2023-11-08","cited_by_count":13,"area":null},{"id":"2210.12170","title":"Discovering Differences in the Representation of People using Contextualized Semantic Axes","created":"2022-10-21","cited_by_count":12,"area":null},{"id":"2305.19358","title":"Stable Anisotropic Regularization","created":"2023-05-30","cited_by_count":12,"area":null},{"id":"2310.11923","title":"Investigating semantic subspaces of Transformer sentence embeddings through linear structural probing","created":"2023-10-18","cited_by_count":12,"area":null},{"id":"2503.11302","title":"Are formal and functional linguistic mechanisms dissociated in language models?","created":"2025-03-14","cited_by_count":11,"area":null},{"id":"2402.00024","title":"Can Large Language Models Understand Molecules?","created":"2024-01-05","cited_by_count":10,"area":null},{"id":"2405.19279","title":"Understanding and Minimising Outlier Features in Neural Network Training","created":"2024-05-29","cited_by_count":10,"area":null},{"id":"2203.09326","title":"Combining Static and Contextualised Multilingual Embeddings","created":"2022-03-17","cited_by_count":8,"area":null},{"id":"2209.00218","title":"Isotropic Representation Can Improve Dense Retrieval","created":"2022-09-01","cited_by_count":8,"area":null},{"id":"2305.09785","title":"Distilling Semantic Concept Embeddings from Contrastively Fine-Tuned Language Models","created":"2023-05-16","cited_by_count":8,"area":null},{"id":"2305.18657","title":"Representation Of Lexical Stylistic Features In Language Models' Embedding Space","created":"2023-05-29","cited_by_count":8,"area":null},{"id":"2310.00313","title":"Decoding In-Context Learning: Neuroscience-inspired Analysis of Representations in Large Language Models","created":"2023-09-30","cited_by_count":7,"area":null},{"id":"2408.08073","title":"Extracting Sentence Embeddings from Pretrained Transformer Models","created":"2024-08-15","cited_by_count":7,"area":null},{"id":"2312.02730","title":"Towards Measuring Representational Similarity of Large Language Models","created":"2023-12-05","cited_by_count":6,"area":null},{"id":"2406.01468","title":"Understanding Token Probability Encoding in Output Embeddings","created":"2024-06-03","cited_by_count":6,"area":null},{"id":"2209.07496","title":"Unsupervised Opinion Summarization Using Approximate Geodesics","created":"2022-09-15","cited_by_count":5,"area":null},{"id":"2311.09130","title":"Social Meme-ing: Measuring Linguistic Variation in Memes","created":"2023-11-15","cited_by_count":5,"area":null},{"id":"2406.15035","title":"Improving Interpretability and Robustness for the Detection of AI-Generated Images","created":"2024-06-21","cited_by_count":5,"area":null},{"id":"2605.05683","title":"Spectral Lens: Activation and Gradient Spectra as Diagnostics of LLM Optimization","created":"2026-05-07","cited_by_count":5,"area":null},{"id":"2205.12302","title":"Garden-Path Traversal in GPT-2","created":"2022-05-24","cited_by_count":4,"area":null},{"id":"2311.18364","title":"Hubness Reduction Improves Sentence-BERT Semantic Spaces","created":"2023-11-30","cited_by_count":4,"area":null},{"id":"2402.03191","title":"Isotropy, Clusters, and Classifiers","created":"2024-02-05","cited_by_count":4,"area":null},{"id":"2506.01042","title":"Probing Neural Topology of Large Language Models","created":"2025-06-01","cited_by_count":4,"area":null},{"id":"2408.01966","title":"ML-EAT: A Multilevel Embedding Association Test for Interpretable and Transparent Social Science","created":"2024-08-04","cited_by_count":3,"area":null},{"id":"2408.04162","title":"Semantics or spelling? Probing contextual word embeddings with orthographic noise","created":"2024-08-08","cited_by_count":3,"area":null},{"id":"2501.04784","title":"Leveraging Registers in Vision Transformers for Robust Adaptation","created":"2025-01-08","cited_by_count":3,"area":null},{"id":"2503.21718","title":"Not a nuisance but a useful heuristic: Outlier dimensions favor frequent tokens in language models","created":"2025-03-27","cited_by_count":3,"area":null},{"id":"2602.16729","title":"Intent Laundering: AI Safety Datasets Are Not What They Seem","created":"2026-02-17","cited_by_count":3,"area":null},{"id":"2602.20433","title":"Disentangling Geometry, Performance, and Training in Language Models","created":"2026-02-24","cited_by_count":3,"area":null},{"id":"2604.08764","title":"Revisiting Anisotropy in Language Transformers: The Geometry of Learning Dynamics","created":"2026-04-09","cited_by_count":3,"area":null},{"id":"2204.02906","title":"Knowledge Base Index Compression via Dimensionality and Precision Reduction","created":"2022-04-06","cited_by_count":2,"area":null},{"id":"2302.03905","title":"COMBO: A Complete Benchmark for Open KG Canonicalization","created":"2023-02-08","cited_by_count":2,"area":null},{"id":"2310.06977","title":"Why bother with geometry? On the relevance of linear decompositions of Transformer embeddings","created":"2023-10-10","cited_by_count":2,"area":null},{"id":"2410.17759","title":"Latent Structures of Intertextuality in French Fiction","created":"2024-10-23","cited_by_count":2,"area":null},{"id":"2502.05704","title":"Rethinking Word Similarity: Semantic Similarity through Classification Confusion","created":"2025-02-08","cited_by_count":2,"area":null},{"id":"2507.21750","title":"Adversarial Defence without Adversarial Defence: Enhancing Language Model Robustness via Instance-level Principal Component Removal","created":"2025-07-29","cited_by_count":2,"area":null},{"id":"2509.01606","title":"Testing the assumptions about the geometry of sentence embedding spaces: the cosine measure need not apply","created":"2025-09-01","cited_by_count":2,"area":null},{"id":"2509.20124","title":"Probability Signature: Bridging Data Semantics and Embedding Structure in Language Models","created":"2025-09-24","cited_by_count":2,"area":null},{"id":"2510.07613","title":"Vocabulary embeddings organize linguistic structure early in language model training","created":"2025-10-08","cited_by_count":2,"area":null},{"id":"2602.05971","title":"Characterizing Human Semantic Navigation in Concept Production as Trajectories in Embedding Space","created":"2026-02-05","cited_by_count":2,"area":null},{"id":"2605.08504","title":"A Single Layer to Explain Them All:Understanding Massive Activations in Large Language Models","created":"2026-05-08","cited_by_count":2,"area":null},{"id":"2608.25768","title":"MoganBert-TR: A Turkish Encoder Foundation Model Trained from Scratch with a CLM-to-MLM Curriculum","created":"2026-08-26","cited_by_count":2,"area":null},{"id":"2112.11638","title":"Consistency and Coherence from Points of Contextual Similarity","created":"2021-12-22","cited_by_count":1,"area":null},{"id":"2203.15364","title":"The Inefficiency of Language Models in Scholarly Retrieval: An Experimental Walk-through","created":"2022-03-29","cited_by_count":1,"area":null},{"id":"2303.17324","title":"Topics in the Haystack: Extracting and Evaluating Topics beyond Coherence","created":"2023-03-30","cited_by_count":1,"area":null},{"id":"2306.10964","title":"Multilingual Few-Shot Learning via Language Model Retrieval","created":"2023-06-19","cited_by_count":1,"area":null},{"id":"2402.07817","title":"Injecting Wiktionary to improve token-level contextual representations using contrastive learning","created":"2024-02-12","cited_by_count":1,"area":null},{"id":"2406.12336","title":"Investigating Distributions of Telecom Adapted Sentence Embeddings for Document Retrieval","created":"2024-06-18","cited_by_count":1,"area":null},{"id":"2407.12886","title":"Whitening Not Recommended for Classification Tasks in LLMs","created":"2024-07-16","cited_by_count":1,"area":null},{"id":"2410.07505","title":"CrossQuant: A Post-Training Quantization Method with Smaller Quantization Kernel for Precise Large Language Model Compression","created":"2024-10-10","cited_by_count":1,"area":null},{"id":"2411.02610","title":"Investigating Idiomaticity in Word Representations","created":"2024-11-04","cited_by_count":1,"area":null},{"id":"2505.11829","title":"Class Distillation with Mahalanobis Contrast: An Efficient Training Paradigm for Pragmatic Language Understanding Tasks","created":"2025-05-17","cited_by_count":1,"area":null},{"id":"2506.11096","title":"Assessing the Impact of Anisotropy in Neural Representations of Speech: A Case Study on Keyword Spotting","created":"2025-06-06","cited_by_count":1,"area":null},{"id":"2510.01652","title":"Learning to Look at the Other Side: A Semantic Probing Study of Word Embeddings in LLMs with Enabled Bidirectional Attention","created":"2025-10-02","cited_by_count":1,"area":null},{"id":"2602.11169","title":"Disentangling Direction and Magnitude in Transformer Representations: A Double Dissociation Through L2-Matched Perturbation Analysis","created":"2026-01-19","cited_by_count":1,"area":null},{"id":"2603.10444","title":"The Curse and Blessing of Mean Bias in FP4-Quantized LLM Training","created":"2026-03-11","cited_by_count":1,"area":null},{"id":"2603.21437","title":"Pooling and Semantic Shift: The Fundamental Challenges in Long Text Embedding and Retrieval","created":"2026-03-22","cited_by_count":1,"area":null},{"id":"2603.23821","title":"Perturbation: A simple and efficient adversarial tracer for representation learning in language models","created":"2026-03-25","cited_by_count":1,"area":null},{"id":"2604.11749","title":"HistLens: Mapping Idea Change across Concepts and Corpora","created":"2026-04-13","cited_by_count":1,"area":null},{"id":"2605.05710","title":"On the Blessing of Pre-training in Weak-to-Strong Generalization","created":"2026-05-07","cited_by_count":1,"area":null},{"id":"2606.19668","title":"Code-Switching Reveals Language Anchoring in Multilingual LLMs","created":"2026-06-18","cited_by_count":1,"area":null},{"id":"2606.20743","title":"Massive Activations Are Architecturally Robust: A Controlled Scratch/Commitment Residual Stream Test","created":"2026-06-17","cited_by_count":1,"area":null},{"id":"2608.01816","title":"Divergent large language model predictions from convergent representations in ambiguous word pairs","created":"2026-08-03","cited_by_count":1,"area":null},{"id":"2609.10210","title":"Through the Looking Glass: Directly Reading and Writing Transformers","created":"2026-09-09","cited_by_count":1,"area":null},{"id":"2309.11895","title":"Audio Contrastive-based Fine-tuning: Decoupling Representation Learning and Classification","created":"2023-09-21","cited_by_count":0,"area":null},{"id":"2411.12147","title":"JuniperLiu at CoMeDi Shared Task: Models as Annotators in Lexical Semantics Disagreements","created":"2024-11-19","cited_by_count":0,"area":null}],"next_cursor":"100"}