{"total":44,"rows":[{"id":"2106.12672","title":"Charformer: Fast Character Transformers via Gradient-based Subword Tokenization","created":"2021-06-23","cited_by_count":160,"area":null},{"id":"2204.08832","title":"Impact of Tokenization on Language Models: An Analysis for Turkish","created":"2022-04-19","cited_by_count":62,"area":null},{"id":"2106.11360","title":"Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records","created":"2021-06-21","cited_by_count":54,"area":null},{"id":"2108.07344","title":"IsoScore: Measuring the Uniformity of Embedding Space Utilization","created":"2021-08-16","cited_by_count":53,"area":null},{"id":"2105.01735","title":"HerBERT: Efficiently Pretrained Transformer-based Language Model for Polish","created":"2021-05-04","cited_by_count":51,"area":null},{"id":"2212.01488","title":"Event knowledge in large language models: the gap between the impossible and the unlikely","created":"2022-12-02","cited_by_count":45,"area":null},{"id":"2110.00672","title":"Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models","created":"2021-10-01","cited_by_count":39,"area":null},{"id":"2110.06490","title":"Dict-BERT: Enhancing Language Model Pre-training with Dictionary","created":"2021-10-13","cited_by_count":38,"area":null},{"id":"2106.01183","title":"A Cluster-based Approach for Improving Isotropy in Contextual Embedding Space","created":"2021-06-02","cited_by_count":27,"area":null},{"id":"2109.03127","title":"Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings","created":"2021-09-07","cited_by_count":27,"area":null},{"id":"2105.07452","title":"How is BERT surprised? Layerwise detection of linguistic anomalies","created":"2021-05-16","cited_by_count":24,"area":null},{"id":"2104.05274","title":"Learning to Remove: Towards Isotropic Pre-trained BERT Embedding","created":"2021-04-12","cited_by_count":23,"area":null},{"id":"2311.00522","title":"Text Rendering Strategies for Pixel Language Models","created":"2023-11-01","cited_by_count":22,"area":null},{"id":"2301.11975","title":"Byte Pair Encoding for Symbolic Music","created":"2023-01-27","cited_by_count":19,"area":null},{"id":"2109.04084","title":"Thinking Clearly, Talking Fast: Concept-Guided Non-Autoregressive Generation for Open-Domain Dialogue Systems","created":"2021-09-09","cited_by_count":17,"area":null},{"id":"2306.05644","title":"WSPAlign: Word Alignment Pre-training via Large-Scale Weakly Supervised Span Prediction","created":"2023-06-09","cited_by_count":10,"area":null},{"id":"2212.11115","title":"What Makes for Good Tokenizers in Vision Transformer?","created":"2022-12-21","cited_by_count":9,"area":null},{"id":"2302.02568","title":"Less is More: Understanding Word-level Textual Adversarial Attack via n-gram Frequency Descend","created":"2023-02-06","cited_by_count":9,"area":null},{"id":"2305.18294","title":"Transformer Language Models Handle Word Frequency in Prediction Head","created":"2023-05-29","cited_by_count":8,"area":null},{"id":"2210.05098","title":"IsoVec: Controlling the Relative Isomorphism of Word Embedding Spaces","created":"2022-10-11","cited_by_count":7,"area":null},{"id":"2210.14378","title":"Bilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transport","created":"2022-10-25","cited_by_count":6,"area":null},{"id":"2406.01468","title":"Understanding Token Probability Encoding in Output Embeddings","created":"2024-06-03","cited_by_count":6,"area":null},{"id":"2211.03634","title":"No Word Embedding Model Is Perfect: Evaluating the Representation Accuracy for Social Bias in the Media","created":"2022-11-07","cited_by_count":5,"area":null},{"id":"2212.08172","title":"Reliable Measures of Spread in High Dimensional Latent Spaces","created":"2022-12-15","cited_by_count":5,"area":null},{"id":"2403.11130","title":"Exploring Tokenization Strategies and Vocabulary Sizes for Enhanced Arabic Language Models","created":"2024-03-17","cited_by_count":5,"area":null},{"id":"2104.01046","title":"IITK@LCP at SemEval 2021 Task 1: Classification for Lexical Complexity Regression Task","created":"2021-04-02","cited_by_count":3,"area":null},{"id":"2211.01430","title":"Hierarchies over Vector Space: Orienting Word and Graph Embeddings","created":"2022-11-02","cited_by_count":3,"area":null},{"id":"2411.00680","title":"Zipfian Whitening","created":"2024-11-01","cited_by_count":3,"area":null},{"id":"2104.08410","title":"Identifying the Limits of Cross-Domain Knowledge Transfer for Pretrained Models","created":"2021-04-17","cited_by_count":2,"area":null},{"id":"2211.08203","title":"Investigating the Frequency Distortion of Word Embeddings and Its Impact on Bias Metrics","created":"2022-11-15","cited_by_count":2,"area":null},{"id":"2301.00792","title":"The Undesirable Dependence on Frequency of Gender Bias Metrics Based on Word Embeddings","created":"2023-01-02","cited_by_count":2,"area":null},{"id":"2305.04493","title":"Token-Level Fitting Issues of Seq2seq Models","created":"2023-05-08","cited_by_count":2,"area":null},{"id":"2310.15905","title":"Is Probing All You Need? Indicator Tasks as an Alternative to Probing Embedding Spaces","created":"2023-10-24","cited_by_count":2,"area":null},{"id":"2201.08451","title":"Regional Negative Bias in Word Embeddings Predicts Racial Animus--but only via Name Frequency","created":"2022-01-20","cited_by_count":1,"area":null},{"id":"2406.12159","title":"Exploring the Impact of a Transformer's Latent Space Geometry on Downstream Task Performance","created":"2024-06-18","cited_by_count":1,"area":null},{"id":"2502.08231","title":"Keep your distance: learning dispersed embeddings on $\\mathbb{S}_m$","created":"2025-02-12","cited_by_count":1,"area":null},{"id":"2508.04307","title":"Compressing Large Language Models with PCA Without Performance Loss","created":"2025-08-06","cited_by_count":1,"area":null},{"id":"2101.00674","title":"Recoding latent sentence representations -- Dynamic gradient-based activation modification in RNNs","created":"2021-01-03","cited_by_count":0,"area":null},{"id":"2105.06750","title":"Out-of-Manifold Regularization in Contextual Embedding Space for Text Classification","created":"2021-05-14","cited_by_count":0,"area":null},{"id":"2112.11776","title":"The Importance of the Current Input in Sequence Modeling","created":"2021-12-22","cited_by_count":0,"area":null},{"id":"2303.09782","title":"High Accurate and Explainable Multi-Pill Detection Framework with Graph Neural Network-Assisted Multimodal Data Fusion","created":"2023-03-17","cited_by_count":0,"area":null},{"id":"2305.07826","title":"Frequency-aware Dimension Selection for Static Word Embedding by Mixed Product Distance","created":"2023-05-13","cited_by_count":0,"area":null},{"id":"2408.01308","title":"Reconsidering Degeneration of Token Embeddings with Definitions for Encoder-based Pre-trained Language Models","created":"2024-08-02","cited_by_count":0,"area":null},{"id":"2507.22187","title":"A Scalable Pipeline for Estimating Verb Frame Frequencies Using Large Language Models","created":"2025-07-29","cited_by_count":0,"area":null}],"next_cursor":null}