{"total":55,"rows":[{"id":"2208.07339","title":"LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale","created":"2022-08-15","cited_by_count":906,"area":null},{"id":"2306.11695","title":"A Simple and Effective Pruning Approach for Large Language Models","created":"2023-06-20","cited_by_count":800,"area":null},{"id":"2212.09720","title":"The case for 4-bit precision: k-bit Inference Scaling Laws","created":"2022-12-19","cited_by_count":251,"area":null},{"id":"2209.13325","title":"Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models","created":"2022-09-27","cited_by_count":181,"area":null},{"id":"2310.05175","title":"Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity","created":"2023-10-08","cited_by_count":165,"area":null},{"id":"2401.12143","title":"Anisotropy Is Inherent to Self-Attention in Transformers","created":"2024-01-22","cited_by_count":63,"area":null},{"id":"2304.09145","title":"Outlier Suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling","created":"2023-04-18","cited_by_count":61,"area":null},{"id":"2305.19268","title":"Intriguing Properties of Quantization at Scale","created":"2023-05-30","cited_by_count":49,"area":null},{"id":"2410.17413","title":"Scalable Influence and Fact Tracing for Large Language Model Pretraining","created":"2024-10-22","cited_by_count":42,"area":null},{"id":"2410.10912","title":"AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models","created":"2024-10-14","cited_by_count":36,"area":null},{"id":"2404.06228","title":"Understanding Cross-Lingual Alignment -- A Survey","created":"2024-04-09","cited_by_count":34,"area":null},{"id":"2302.00456","title":"Analyzing Feed-Forward Blocks in Transformers through the Lens of Attention Maps","created":"2023-02-01","cited_by_count":33,"area":null},{"id":"2305.13417","title":"VISIT: Visualizing and Interpreting the Semantic Information Flow of Transformers","created":"2023-05-22","cited_by_count":32,"area":null},{"id":"2410.04010","title":"Hyperbolic Fine-Tuning for Large Language Models","created":"2024-10-05","cited_by_count":27,"area":null},{"id":"2603.05498","title":"The Spike, the Sparse and the Sink: Anatomy of Massive Activations and Attention Sinks","created":"2026-03-05","cited_by_count":27,"area":null},{"id":"2404.03605","title":"Mitigating the Impact of Outlier Channels for Language Model Quantization with Activation Regularization","created":"2024-04-04","cited_by_count":23,"area":null},{"id":"2601.22966","title":"A Unified View of Attention and Residual Sinks: Outlier-Driven Rescaling is Essential for Transformer Training","created":"2026-01-30","cited_by_count":23,"area":null},{"id":"2402.14700","title":"Unveiling Linguistic Regions in Large Language Models","created":"2024-02-22","cited_by_count":22,"area":null},{"id":"2404.07647","title":"Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck","created":"2024-04-11","cited_by_count":21,"area":null},{"id":"2405.14428","title":"Mitigating Quantization Errors Due to Activation Spikes in GLU-Based LLMs","created":"2024-05-23","cited_by_count":21,"area":null},{"id":"2305.17446","title":"Fine-tuning Happens in Tiny Subspaces: Exploring Intrinsic Task-specific Subspaces of Pre-trained Language Models","created":"2023-05-27","cited_by_count":19,"area":null},{"id":"2410.08113","title":"Robust AI-Generated Text Detection by Restricted Embeddings","created":"2024-10-10","cited_by_count":18,"area":null},{"id":"2306.00458","title":"Exploring Anisotropy and Outliers in Multilingual Language Models for Cross-Lingual Semantic Sentence Similarity","created":"2023-06-01","cited_by_count":17,"area":null},{"id":"2403.00986","title":"Merging Text Transformer Models from Different Initializations","created":"2024-03-01","cited_by_count":16,"area":null},{"id":"2410.01444","title":"Geometric Signatures of Compositionality Across a Language Model's Lifetime","created":"2024-10-02","cited_by_count":16,"area":null},{"id":"2502.00919","title":"Attention Sinks: A 'Catch, Tag, Release' Mechanism for Embeddings","created":"2025-02-02","cited_by_count":16,"area":null},{"id":"2310.17715","title":"Outlier Dimensions Encode Task-Specific Knowledge","created":"2023-10-26","cited_by_count":15,"area":null},{"id":"2405.19279","title":"Understanding and Minimising Outlier Features in Neural Network Training","created":"2024-05-29","cited_by_count":10,"area":null},{"id":"2509.00404","title":"Metis: Training LLMs with FP4 Quantization","created":"2025-08-30","cited_by_count":9,"area":null},{"id":"2405.18380","title":"Outlier-weighed Layerwise Sampling for LLM Fine-tuning","created":"2024-05-28","cited_by_count":8,"area":null},{"id":"2503.01874","title":"CABS: Conflict-Aware and Balanced Sparsification for Enhancing Model Merging","created":"2025-02-26","cited_by_count":8,"area":null},{"id":"2505.00598","title":"Fast and Low-Cost Genomic Foundation Models via Outlier Removal","created":"2025-05-01","cited_by_count":8,"area":null},{"id":"2508.17744","title":"Randomly Removing 50% of Dimensions in Text Embeddings has Minimal Impact on Retrieval and Classification Tasks","created":"2025-08-25","cited_by_count":8,"area":null},{"id":"2212.09686","title":"A Natural Bias for Language Generation Models","created":"2022-12-19","cited_by_count":6,"area":null},{"id":"2505.23807","title":"DLP: Dynamic Layerwise Pruning in Large Language Models","created":"2025-05-27","cited_by_count":6,"area":null},{"id":"2511.23225","title":"TWEO: Transformers Without Extreme Outliers Enables FP8 Training And Quantization For Dummies","created":"2025-11-28","cited_by_count":6,"area":null},{"id":"2306.07656","title":"Is Anisotropy Inherent to Transformers?","created":"2023-06-13","cited_by_count":5,"area":null},{"id":"2309.08351","title":"Headless Language Models: Learning without Predicting with Contrastive Weight Tying","created":"2023-09-15","cited_by_count":5,"area":null},{"id":"2406.15035","title":"Improving Interpretability and Robustness for the Detection of AI-Generated Images","created":"2024-06-21","cited_by_count":5,"area":null},{"id":"2411.15113","title":"Efficient Pruning of Text-to-Image Models: Insights from Pruning Stable Diffusion","created":"2024-11-22","cited_by_count":5,"area":"diffusion"},{"id":"2503.21718","title":"Not a nuisance but a useful heuristic: Outlier dimensions favor frequent tokens in language models","created":"2025-03-27","cited_by_count":3,"area":null},{"id":"2602.12556","title":"SD-MoE: Spectral Decomposition for Effective Expert Specialization","created":"2026-02-13","cited_by_count":3,"area":"moe"},{"id":"2502.10735","title":"Beyond One-Size-Fits-All Pruning via Evolutionary Metric Search for Large Language Models","created":"2025-02-15","cited_by_count":2,"area":null},{"id":"2410.07505","title":"CrossQuant: A Post-Training Quantization Method with Smaller Quantization Kernel for Precise Large Language Model Compression","created":"2024-10-10","cited_by_count":1,"area":null},{"id":"2502.11932","title":"On Representational Dissociation of Language and Arithmetic in Large Language Models","created":"2025-02-17","cited_by_count":1,"area":null},{"id":"2603.10444","title":"The Curse and Blessing of Mean Bias in FP4-Quantized LLM Training","created":"2026-03-11","cited_by_count":1,"area":null},{"id":"2607.17733","title":"MXSens: Sensitivity-Aware Mixed-Precision Quantization for Efficient LLM Inference","created":"2026-07-20","cited_by_count":1,"area":"inference"},{"id":"2410.12292","title":"How much do contextualized representations encode long-range context?","created":"2024-10-16","cited_by_count":0,"area":null},{"id":"2508.20577","title":"MERIT: Maximum-normalized Element-wise Ratio for Language Model Large-batch Training","created":"2025-08-28","cited_by_count":0,"area":null},{"id":"2602.07375","title":"Efficient Post-Training Pruning of Large Language Models with Statistical Correction","created":"2026-02-07","cited_by_count":0,"area":null},{"id":"2606.29571","title":"Anisotropy Decides Cosine vs. Rank Metrics for Text Embeddings","created":"2026-06-28","cited_by_count":0,"area":null},{"id":"2608.12842","title":"CABS+: Efficient and Scalable Model Merging via Conflict-Aware Sparsification and Adaptive Weight Allocation","created":"2026-08-13","cited_by_count":0,"area":null},{"id":"2608.29706","title":"The Depth Flow of Token Representations Is Nonlinear and Does Not Descend Its Own Density","created":"2026-08-30","cited_by_count":0,"area":null},{"id":"2609.31796","title":"Same Probe, Different Numbers: Are Activation Probes Robust to Inference-Time Numerical Non-Determinism?","created":"2026-09-25","cited_by_count":0,"area":null},{"id":"2609.31956","title":"Transformer MLP Gate Thresholds Are Couplings to a Carried Reference Direction","created":"2026-09-25","cited_by_count":0,"area":null}],"next_cursor":null}