{"total":45,"rows":[{"id":"2306.09927","title":"Trained Transformers Learn Linear Models In-Context","created":"2023-06-16","cited_by_count":337,"area":null},{"id":"2409.10594","title":"Kolmogorov-Arnold Transformer","created":"2024-09-16","cited_by_count":56,"area":null},{"id":"2402.10198","title":"SAMformer: Unlocking the Potential of Transformers in Time Series Forecasting with Sharpness-Aware Minimization and Channel-Wise Attention","created":"2024-02-15","cited_by_count":44,"area":null},{"id":"2307.11353","title":"What can a Single Attention Layer Learn? A Study Through the Random Features Lens","created":"2023-07-21","cited_by_count":40,"area":null},{"id":"2311.18823","title":"Initializing Models with Larger Ones","created":"2023-11-30","cited_by_count":39,"area":null},{"id":"2311.01906","title":"Simplifying Transformer Blocks","created":"2023-11-03","cited_by_count":37,"area":null},{"id":"2310.09753","title":"When can transformers reason with abstract symbols?","created":"2023-10-15","cited_by_count":24,"area":null},{"id":"2401.04301","title":"Setting the Record Straight on Transformer Oversmoothing","created":"2024-01-09","cited_by_count":21,"area":null},{"id":"2501.08537","title":"Complexity Control Facilitates Reasoning-Based Compositional Generalization in Transformers","created":"2025-01-15","cited_by_count":20,"area":null},{"id":"2310.04861","title":"Uncovering hidden geometry in Transformers via disentangling position and context","created":"2023-10-07","cited_by_count":18,"area":null},{"id":"2405.05409","title":"Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing","created":"2024-05-08","cited_by_count":17,"area":null},{"id":"2406.17503","title":"WAVE: Weight Templates for Adaptive Initialization of Variable-sized Models","created":"2024-06-25","cited_by_count":17,"area":null},{"id":"2411.09702","title":"On the Surprising Effectiveness of Attention Transfer for Vision Transformers","created":"2024-11-14","cited_by_count":17,"area":null},{"id":"2410.18779","title":"A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs","created":"2024-10-24","cited_by_count":15,"area":null},{"id":"2312.01648","title":"Characterizing Large Language Model Geometry Helps Solve Toxicity Detection and Generation","created":"2023-12-04","cited_by_count":12,"area":null},{"id":"2404.08634","title":"When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models","created":"2024-04-12","cited_by_count":12,"area":null},{"id":"2601.21725","title":"Procedural Pretraining: Warming Up Language Models with Abstract Data","created":"2026-01-29","cited_by_count":10,"area":null},{"id":"2502.10927","title":"The underlying structures of self-attention: symmetry, directionality, and emergent dynamics in Transformer training","created":"2025-02-15","cited_by_count":9,"area":null},{"id":"2510.00345","title":"Cutting the Skip: Training Residual-Free Transformers","created":"2025-09-30","cited_by_count":8,"area":null},{"id":"2511.13945","title":"Can You Learn to See Without Images? Procedural Warm-Up for Vision Transformers","created":"2025-11-17","cited_by_count":8,"area":null},{"id":"2502.05164","title":"In-context denoising with one-layer transformers: connections between attention and associative memory retrieval","created":"2025-02-07","cited_by_count":7,"area":null},{"id":"2505.19985","title":"Structured Initialization for Vision Transformers","created":"2025-05-26","cited_by_count":6,"area":null},{"id":"2402.02969","title":"Towards Understanding the Word Sensitivity of Attention Layers: A Study via Random Features","created":"2024-02-05","cited_by_count":5,"area":null},{"id":"2401.12511","title":"Convolutional Initialization for Data-Efficient Vision Transformers","created":"2024-01-23","cited_by_count":4,"area":null},{"id":"2404.01139","title":"Structured Initialization for Attention in Vision Transformers","created":"2024-04-01","cited_by_count":4,"area":null},{"id":"2408.13152","title":"Long-term Pre-training for Temporal Action Detection with Transformers","created":"2024-08-23","cited_by_count":3,"area":null},{"id":"2505.13813","title":"FlashKAT: Understanding and Addressing Performance Bottlenecks in the Kolmogorov-Arnold Transformer","created":"2025-05-20","cited_by_count":3,"area":null},{"id":"2605.07191","title":"Attention Transfer Is Not Universally Effective for Vision Transformers","created":"2026-05-08","cited_by_count":3,"area":null},{"id":"2405.13901","title":"Discrete Cosine Transform Based Decorrelated Attention for Vision Transformers","created":"2024-05-22","cited_by_count":2,"area":null},{"id":"2602.07156","title":"Mimetic Initialization of MLPs","created":"2026-02-06","cited_by_count":2,"area":null},{"id":"2603.07506","title":"A Unified Framework for Knowledge Transfer in Bidirectional Model Scaling","created":"2026-03-08","cited_by_count":2,"area":null},{"id":"2309.13570","title":"Robust 6DoF Pose Estimation Against Depth Noise and a Comprehensive Evaluation on a Mobile Dataset","created":"2023-09-24","cited_by_count":1,"area":null},{"id":"2411.11189","title":"Freqformer: Frequency-Domain Transformer for 3-D Reconstruction and Quantification of Human Retinal Vasculature","created":"2024-11-17","cited_by_count":1,"area":null},{"id":"2606.07600","title":"Reachability and asymptotics of Gaussian Transformer dynamics","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2608.00418","title":"Making Transformers Logical","created":"2026-08-01","cited_by_count":1,"area":null},{"id":"2601.19694","title":"Self-Supervised Weight Templates for Scalable Vision Model Initialization","created":"2026-01-27","cited_by_count":0,"area":null},{"id":"2603.07523","title":"Breaking the Scale Barrier: One-Shot Knowledge Transfer via Frequency Transform","created":"2026-03-08","cited_by_count":0,"area":null},{"id":"2604.14769","title":"Constraint-based Pre-training: From Structured Constraints to Scalable Model Initialization","created":"2026-04-16","cited_by_count":0,"area":null},{"id":"2606.26894","title":"Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI","created":"2026-06-25","cited_by_count":0,"area":null},{"id":"2609.01311","title":"One-Layer Transformer Provably Learns Multiclass One-Nearest Neighbor in Context","created":"2026-09-01","cited_by_count":0,"area":null},{"id":"2609.07086","title":"Conditioned Initialization for Attention","created":"2026-09-07","cited_by_count":0,"area":null},{"id":"2609.35745","title":"Copy the Same, Distill the Difference: Initializing Linear Vision Transformers","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2609.37631","title":"Procedural Core: A Compact Recurrent Initialization for Vision Transformers","created":"2026-09-29","cited_by_count":0,"area":null},{"id":"2609.37921","title":"Pattern Formation in Transformers","created":"2026-09-29","cited_by_count":0,"area":null},{"id":"2610.14770","title":"Prior-Fitted and Frozen Scorers for Multimodal Contrastive Learning","created":"2026-10-10","cited_by_count":0,"area":null}],"next_cursor":null}