{"total":213,"rows":[{"id":"2104.08821","title":"SimCSE: Simple Contrastive Learning of Sentence Embeddings","created":"2021-04-18","cited_by_count":2173,"area":null},{"id":"2208.07339","title":"LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale","created":"2022-08-15","cited_by_count":906,"area":null},{"id":"2203.02053","title":"Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning","created":"2022-03-03","cited_by_count":561,"area":null},{"id":"2412.13663","title":"Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference","created":"2024-12-18","cited_by_count":554,"area":null},{"id":"2212.09720","title":"The case for 4-bit precision: k-bit Inference Scaling Laws","created":"2022-12-19","cited_by_count":251,"area":null},{"id":"2105.11741","title":"ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer","created":"2021-05-25","cited_by_count":231,"area":null},{"id":"2103.15316","title":"Whitening Sentence Representations for Better Semantics and Faster Retrieval","created":"2021-03-29","cited_by_count":202,"area":null},{"id":"2109.04404","title":"All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality","created":"2021-09-09","cited_by_count":156,"area":null},{"id":"2307.03170","title":"Focused Transformer: Contrastive Training for Context Scaling","created":"2023-07-06","cited_by_count":133,"area":null},{"id":"2209.02535","title":"Analyzing Transformers in Embedding Space","created":"2022-09-06","cited_by_count":132,"area":null},{"id":"2102.08473","title":"COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining","created":"2021-02-16","cited_by_count":126,"area":null},{"id":"2407.13623","title":"Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies","created":"2024-07-18","cited_by_count":118,"area":null},{"id":"2111.06091","title":"A Survey of Visual Transformers","created":"2021-11-11","cited_by_count":117,"area":null},{"id":"2201.04337","title":"PromptBERT: Improving BERT Sentence Embeddings with Prompts","created":"2022-01-12","cited_by_count":75,"area":null},{"id":"2401.12143","title":"Anisotropy Is Inherent to Self-Attention in Transformers","created":"2024-01-22","cited_by_count":63,"area":null},{"id":"2502.01951","title":"On the Emergence of Position Bias in Transformers","created":"2025-02-04","cited_by_count":59,"area":null},{"id":"2211.09510","title":"Self-supervised Trajectory Representation Learning with Temporal Regularities and Travel Semantics","created":"2022-11-17","cited_by_count":58,"area":null},{"id":"2205.11380","title":"Outliers Dimensions that Disrupt Transformers Are Driven by Frequency","created":"2022-05-23","cited_by_count":55,"area":null},{"id":"2209.01814","title":"RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detection","created":"2022-09-05","cited_by_count":55,"area":null},{"id":"2108.07344","title":"IsoScore: Measuring the Uniformity of Embedding Space Utilization","created":"2021-08-16","cited_by_count":53,"area":null},{"id":"2405.18781","title":"On the Role of Attention Masks and LayerNorm in Transformers","created":"2024-05-29","cited_by_count":48,"area":null},{"id":"2104.12753","title":"Vision Transformers with Patch Diversification","created":"2021-04-26","cited_by_count":45,"area":null},{"id":"2303.06562","title":"ContraNorm: A Contrastive Learning Perspective on Oversmoothing and Beyond","created":"2023-03-12","cited_by_count":39,"area":null},{"id":"2311.05928","title":"The Shape of Learning: Anisotropy and Intrinsic Dimensions in Transformer-Based Models","created":"2023-11-10","cited_by_count":39,"area":null},{"id":"2110.06490","title":"Dict-BERT: Enhancing Language Model Pre-training with Dictionary","created":"2021-10-13","cited_by_count":38,"area":null},{"id":"2203.06345","title":"The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy","created":"2022-03-12","cited_by_count":35,"area":null},{"id":"2404.06228","title":"Understanding Cross-Lingual Alignment -- A Survey","created":"2024-04-09","cited_by_count":34,"area":null},{"id":"2106.01183","title":"A Cluster-based Approach for Improving Isotropy in Contextual Embedding Space","created":"2021-06-02","cited_by_count":27,"area":null},{"id":"2109.03127","title":"Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings","created":"2021-09-07","cited_by_count":27,"area":null},{"id":"2410.04010","title":"Hyperbolic Fine-Tuning for Large Language Models","created":"2024-10-05","cited_by_count":27,"area":null},{"id":"2110.04504","title":"An Isotropy Analysis in the Multilingual BERT Embedding Space","created":"2021-10-09","cited_by_count":25,"area":null},{"id":"2202.13093","title":"Exploring the Impact of Negative Samples of Contrastive Learning: A Case Study of Sentence Embedding","created":"2022-02-26","cited_by_count":25,"area":null},{"id":"2408.04604","title":"Towards High-resolution 3D Anomaly Detection via Group-Level Feature Contrastive Learning","created":"2024-08-08","cited_by_count":25,"area":null},{"id":"2408.15417","title":"Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representations","created":"2024-08-27","cited_by_count":24,"area":null},{"id":"2104.05274","title":"Learning to Remove: Towards Isotropic Pre-trained BERT Embedding","created":"2021-04-12","cited_by_count":23,"area":null},{"id":"2109.04740","title":"How Does Fine-tuning Affect the Geometry of Embedding Space: A Case Study on Isotropy","created":"2021-09-10","cited_by_count":23,"area":null},{"id":"2405.16700","title":"Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs","created":"2024-05-26","cited_by_count":23,"area":null},{"id":"2204.03293","title":"CoCoSoDa: Effective Contrastive Learning for Code Search","created":"2022-04-07","cited_by_count":22,"area":null},{"id":"2305.14280","title":"Multilingual Pixel Representations for Translation and Effective Cross-lingual Transfer","created":"2023-05-23","cited_by_count":22,"area":null},{"id":"2311.00522","title":"Text Rendering Strategies for Pixel Language Models","created":"2023-11-01","cited_by_count":22,"area":null},{"id":"2404.07647","title":"Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck","created":"2024-04-11","cited_by_count":21,"area":null},{"id":"2205.07208","title":"Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization","created":"2022-05-15","cited_by_count":19,"area":null},{"id":"2301.11975","title":"Byte Pair Encoding for Symbolic Music","created":"2023-01-27","cited_by_count":19,"area":null},{"id":"2308.00189","title":"Generative Models as a Complex Systems Science: How can we make sense of large language model behavior?","created":"2023-07-31","cited_by_count":19,"area":null},{"id":"2210.01185","title":"ContraCLM: Contrastive Learning For Causal Language Model","created":"2022-10-03","cited_by_count":18,"area":null},{"id":"2308.16800","title":"Rank Collapse Causes Over-Smoothing and Over-Correlation in Graph Neural Networks","created":"2023-08-31","cited_by_count":18,"area":null},{"id":"2310.04861","title":"Uncovering hidden geometry in Transformers via disentangling position and context","created":"2023-10-07","cited_by_count":18,"area":null},{"id":"2306.00458","title":"Exploring Anisotropy and Outliers in Multilingual Language Models for Cross-Lingual Semantic Sentence Similarity","created":"2023-06-01","cited_by_count":17,"area":null},{"id":"2308.10261","title":"How Good Are LLMs at Out-of-Distribution Detection?","created":"2023-08-20","cited_by_count":17,"area":null},{"id":"2212.09170","title":"On Isotropy, Contextualization and Learning Dynamics of Contrastive-based Sentence Representation Learning","created":"2022-12-18","cited_by_count":15,"area":null},{"id":"2310.17715","title":"Outlier Dimensions Encode Task-Specific Knowledge","created":"2023-10-26","cited_by_count":15,"area":null},{"id":"2208.11790","title":"Addressing Token Uniformity in Transformers via Singular Value Transformation","created":"2022-08-24","cited_by_count":14,"area":null},{"id":"2104.10833","title":"Low Anisotropy Sense Retrofitting (LASeR) : Towards Isotropic and Sense Enriched Representations","created":"2021-04-22","cited_by_count":13,"area":null},{"id":"2309.15223","title":"Low-rank Adaptation of Large Language Model Rescoring for Parameter-Efficient Speech Recognition","created":"2023-09-26","cited_by_count":13,"area":null},{"id":"2305.19358","title":"Stable Anisotropic Regularization","created":"2023-05-30","cited_by_count":12,"area":null},{"id":"2112.14484","title":"Frequency-Aware Contrastive Learning for Neural Machine Translation","created":"2021-12-29","cited_by_count":11,"area":null},{"id":"2210.07547","title":"Kernel-Whitening: Overcome Dataset Bias with Isotropic Sentence Embedding","created":"2022-10-14","cited_by_count":11,"area":null},{"id":"2212.08853","title":"HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation","created":"2022-12-17","cited_by_count":11,"area":null},{"id":"2303.01081","title":"Can BERT Refrain from Forgetting on Sequential Tasks? A Probing Study","created":"2023-03-02","cited_by_count":11,"area":null},{"id":"2310.19453","title":"FLIP: Fine-grained Alignment between ID-based Models and Pretrained Language Models for CTR Prediction","created":"2023-10-30","cited_by_count":11,"area":null},{"id":"2204.04916","title":"A Token-level Contrastive Framework for Sign Language Translation","created":"2022-04-11","cited_by_count":10,"area":null},{"id":"2302.02060","title":"Representation Deficiency in Masked Language Modeling","created":"2023-02-04","cited_by_count":10,"area":null},{"id":"2308.14029","title":"Text Matching Improves Sequential Recommendation by Reducing Popularity Biases","created":"2023-08-27","cited_by_count":10,"area":null},{"id":"2312.04142","title":"TimeDRL: Disentangled Representation Learning for Multivariate Time-Series","created":"2023-12-07","cited_by_count":10,"area":null},{"id":"2405.19279","title":"Understanding and Minimising Outlier Features in Neural Network Training","created":"2024-05-29","cited_by_count":10,"area":null},{"id":"2507.14900","title":"From Neurons to Semantics: Evaluating Cross-Linguistic Alignment Capabilities of Large Language Models via Neurons Alignment","created":"2025-07-20","cited_by_count":9,"area":null},{"id":"2603.10145","title":"Lost in Backpropagation: The LM Head is a Gradient Bottleneck","created":"2026-03-10","cited_by_count":9,"area":null},{"id":"2208.08678","title":"Mere Contrastive Learning for Cross-Domain Sentiment Analysis","created":"2022-08-18","cited_by_count":8,"area":null},{"id":"2209.00218","title":"Isotropic Representation Can Improve Dense Retrieval","created":"2022-09-01","cited_by_count":8,"area":null},{"id":"2305.18657","title":"Representation Of Lexical Stylistic Features In Language Models' Embedding Space","created":"2023-05-29","cited_by_count":8,"area":null},{"id":"2402.08183","title":"Pixel Sentence Representation Learning","created":"2024-02-13","cited_by_count":8,"area":null},{"id":"2403.09209","title":"LAN: Learning Adaptive Neighbors for Real-Time Insider Threat Detection","created":"2024-03-14","cited_by_count":8,"area":null},{"id":"2205.10227","title":"Label Anchored Contrastive Learning for Language Understanding","created":"2022-04-26","cited_by_count":7,"area":null},{"id":"2304.10309","title":"Improving Speech Translation by Cross-Modal Multi-Grained Contrastive Learning","created":"2023-04-20","cited_by_count":7,"area":null},{"id":"2506.24106","title":"On the Predictive Power of Representation Dispersion in Language Models","created":"2025-06-30","cited_by_count":7,"area":null},{"id":"2606.22019","title":"Channel Location Constrains the Auditability of Subliminal Learning","created":"2026-06-20","cited_by_count":7,"area":null},{"id":"2209.06453","title":"Prompt Combines Paraphrase: Teaching Pre-trained Models to Understand Rare Biomedical Words","created":"2022-09-14","cited_by_count":6,"area":null},{"id":"2210.11989","title":"Optimizing text representations to capture (dis)similarity between political parties","created":"2022-10-21","cited_by_count":6,"area":null},{"id":"2306.06381","title":"INK: Injecting kNN Knowledge in Nearest Neighbor Machine Translation","created":"2023-06-10","cited_by_count":6,"area":null},{"id":"2306.15268","title":"Can Pretrained Language Models Derive Correct Semantics from Corrupt Subwords under Noise?","created":"2023-06-27","cited_by_count":6,"area":null},{"id":"2310.16193","title":"Length is a Curse and a Blessing for Document-level Semantics","created":"2023-10-24","cited_by_count":6,"area":null},{"id":"2406.01468","title":"Understanding Token Probability Encoding in Output Embeddings","created":"2024-06-03","cited_by_count":6,"area":null},{"id":"2202.13392","title":"A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models","created":"2022-02-27","cited_by_count":5,"area":null},{"id":"2212.08172","title":"Reliable Measures of Spread in High Dimensional Latent Spaces","created":"2022-12-15","cited_by_count":5,"area":null},{"id":"2305.12786","title":"Mitigating Data Imbalance and Representation Degeneration in Multilingual Machine Translation","created":"2023-05-22","cited_by_count":5,"area":null},{"id":"2306.07656","title":"Is Anisotropy Inherent to Transformers?","created":"2023-06-13","cited_by_count":5,"area":null},{"id":"2309.07396","title":"DebCSE: Rethinking Unsupervised Contrastive Sentence Embedding Learning in the Debiasing Perspective","created":"2023-09-14","cited_by_count":5,"area":null},{"id":"2309.08351","title":"Headless Language Models: Learning without Predicting with Contrastive Weight Tying","created":"2023-09-15","cited_by_count":5,"area":null},{"id":"2401.17092","title":"NNOSE: Nearest Neighbor Occupational Skill Extraction","created":"2024-01-30","cited_by_count":5,"area":null},{"id":"2503.02142","title":"Measuring Intrinsic Dimension of Token Embeddings","created":"2025-03-04","cited_by_count":5,"area":null},{"id":"2305.13297","title":"Investigating the Role of Feed-Forward Networks in Transformers Using Parallel Attention and Feed-Forward Net Design","created":"2023-05-22","cited_by_count":4,"area":null},{"id":"2305.13641","title":"AxomiyaBERTa: A Phonologically-aware Transformer Model for Assamese","created":"2023-05-23","cited_by_count":4,"area":null},{"id":"2310.05128","title":"Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classification","created":"2023-10-08","cited_by_count":4,"area":null},{"id":"2310.13276","title":"InvGC: Robust Cross-Modal Retrieval by Inverse Graph Convolution","created":"2023-10-20","cited_by_count":4,"area":null},{"id":"2310.13675","title":"On Synthetic Data for Back Translation","created":"2023-10-20","cited_by_count":4,"area":null},{"id":"2502.08441","title":"Better Embeddings with Coupled Adam","created":"2025-02-12","cited_by_count":4,"area":null},{"id":"2507.13105","title":"SemCSE: Semantic Contrastive Sentence Embeddings Using LLM-Generated Summaries For Scientific Abstracts","created":"2025-07-17","cited_by_count":4,"area":null},{"id":"2601.02031","title":"Output Embedding Centering for Stable LLM Pretraining","created":"2026-01-05","cited_by_count":4,"area":null},{"id":"2605.06152","title":"Grokking or Glitching? How Low-Precision Drives Slingshot Loss Spikes","created":"2026-05-07","cited_by_count":4,"area":null},{"id":"2605.12292","title":"STRABLE: Benchmarking Tabular Machine Learning with Strings","created":"2026-05-12","cited_by_count":4,"area":null}],"next_cursor":"100"}