{"total":104,"rows":[{"id":"2302.05442","title":"Scaling Vision Transformers to 22 Billion Parameters","created":"2023-02-10","cited_by_count":694,"area":null},{"id":"2204.02937","title":"Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations","created":"2022-04-06","cited_by_count":381,"area":null},{"id":"2202.06991","title":"Transformer Memory as a Differentiable Search Index","created":"2022-02-14","cited_by_count":247,"area":null},{"id":"2307.06304","title":"Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution","created":"2023-07-12","cited_by_count":229,"area":null},{"id":"2408.12569","title":"Sapiens: Foundation for Human Vision Models","created":"2024-08-22","cited_by_count":229,"area":null},{"id":"2211.04325","title":"Will we run out of data? Limits of LLM scaling based on human-generated data","created":"2022-10-26","cited_by_count":195,"area":null},{"id":"2311.00566","title":"CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoders","created":"2023-11-01","cited_by_count":169,"area":null},{"id":"2401.00448","title":"Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws","created":"2023-12-31","cited_by_count":159,"area":null},{"id":"2206.06565","title":"LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks","created":"2022-06-14","cited_by_count":148,"area":null},{"id":"2209.06640","title":"Revisiting Neural Scaling Laws in Language and Vision","created":"2022-09-13","cited_by_count":132,"area":null},{"id":"2405.10938","title":"Observational Scaling Laws and the Predictability of Language Model Performance","created":"2024-05-17","cited_by_count":130,"area":null},{"id":"2210.05643","title":"A Kernel-Based View of Language Model Fine-Tuning","created":"2022-10-11","cited_by_count":121,"area":null},{"id":"2201.08371","title":"Revisiting Weakly Supervised Pre-Training of Visual Perception Models","created":"2022-01-20","cited_by_count":116,"area":null},{"id":"2207.00220","title":"Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset","created":"2022-07-01","cited_by_count":113,"area":null},{"id":"2403.08540","title":"Language models scale reliably with over-training and on downstream tasks","created":"2024-03-13","cited_by_count":113,"area":null},{"id":"2204.03044","title":"Fusing finetuned models for better pretraining","created":"2022-04-06","cited_by_count":110,"area":null},{"id":"2210.14891","title":"Broken Neural Scaling Laws","created":"2022-10-26","cited_by_count":109,"area":null},{"id":"2207.10551","title":"Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?","created":"2022-07-21","cited_by_count":103,"area":null},{"id":"2212.10445","title":"Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization","created":"2022-12-20","cited_by_count":97,"area":null},{"id":"2202.14037","title":"Understanding Contrastive Learning Requires Incorporating Inductive Biases","created":"2022-02-28","cited_by_count":96,"area":null},{"id":"2309.08638","title":"Anchor Points: Benchmarking Models with Much Fewer Examples","created":"2023-09-14","cited_by_count":86,"area":null},{"id":"2503.16252","title":"Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learning","created":"2025-03-20","cited_by_count":83,"area":"lr"},{"id":"2211.01201","title":"Human alignment of neural network representations","created":"2022-11-02","cited_by_count":74,"area":null},{"id":"2407.13193","title":"Retrieval-Augmented Generation for Natural Language Processing: A Survey","created":"2024-07-18","cited_by_count":71,"area":"rag"},{"id":"2303.13496","title":"The effectiveness of MAE pre-pretraining for billion-scale pretraining","created":"2023-03-23","cited_by_count":68,"area":null},{"id":"2110.12899","title":"No One Representation to Rule Them All: Overlapping Features of Training Methods","created":"2021-10-20","cited_by_count":58,"area":null},{"id":"2111.12993","title":"PolyViT: Co-training Vision Transformers on Images, Videos and Audio","created":"2021-11-25","cited_by_count":58,"area":null},{"id":"2110.11403","title":"SCENIC: A JAX Library for Computer Vision Research and Beyond","created":"2021-10-18","cited_by_count":57,"area":null},{"id":"2201.05867","title":"Transferability in Deep Learning: A Survey","created":"2022-01-15","cited_by_count":57,"area":null},{"id":"2205.12253","title":"Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing","created":"2022-05-24","cited_by_count":50,"area":null},{"id":"2402.04177","title":"Scaling Laws for Downstream Task Performance of Large Language Models","created":"2024-02-06","cited_by_count":49,"area":null},{"id":"2301.12246","title":"A Closer Look at Few-shot Classification Again","created":"2023-01-28","cited_by_count":46,"area":null},{"id":"2306.03805","title":"The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Matter","created":"2023-06-06","cited_by_count":42,"area":null},{"id":"2301.04644","title":"Does progress on ImageNet transfer to real-world datasets?","created":"2023-01-11","cited_by_count":35,"area":null},{"id":"2211.09807","title":"Towards All-in-one Pre-training via Maximizing Multi-modal Mutual Information","created":"2022-11-17","cited_by_count":31,"area":null},{"id":"2204.01403","title":"How stable are Transferability Metrics evaluations?","created":"2022-04-04","cited_by_count":30,"area":null},{"id":"2410.11840","title":"A Hitchhiker's Guide to Scaling Law Estimation","created":"2024-10-15","cited_by_count":27,"area":null},{"id":"2202.06387","title":"Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments","created":"2022-02-13","cited_by_count":23,"area":null},{"id":"2207.01725","title":"How Much More Data Do I Need? Estimating Requirements for Downstream Tasks","created":"2022-07-04","cited_by_count":23,"area":null},{"id":"2211.00107","title":"Where to start? Analyzing the potential value of intermediate models","created":"2022-10-31","cited_by_count":23,"area":null},{"id":"2301.13195","title":"Adaptive Computation with Elastic Input Sequence","created":"2023-01-30","cited_by_count":22,"area":null},{"id":"2306.03828","title":"Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How","created":"2023-06-06","cited_by_count":18,"area":null},{"id":"2302.13602","title":"The Role of Pre-training Data in Transfer Learning","created":"2023-02-27","cited_by_count":17,"area":null},{"id":"2301.02419","title":"Exploring Efficient Few-shot Adaptation for Vision Transformers","created":"2023-01-06","cited_by_count":16,"area":null},{"id":"2401.00426","title":"keqing: knowledge-based question answering is a nature chain-of-thought mentor of LLM","created":"2023-12-31","cited_by_count":16,"area":"lr"},{"id":"2402.01909","title":"On Catastrophic Inheritance of Large Foundation Models","created":"2024-02-02","cited_by_count":15,"area":null},{"id":"2411.12925","title":"Loss-to-Loss Prediction: Scaling Laws for All Datasets","created":"2024-11-19","cited_by_count":15,"area":null},{"id":"2311.01038","title":"Better with Less: A Data-Active Perspective on Pre-Training Graph Neural Networks","created":"2023-11-02","cited_by_count":14,"area":null},{"id":"2205.09904","title":"Deep transfer learning for image classification: a survey","created":"2022-05-20","cited_by_count":13,"area":null},{"id":"2307.13136","title":"Does Progress On Object Recognition Benchmarks Improve Real-World Generalization?","created":"2023-07-24","cited_by_count":13,"area":null},{"id":"2402.02054","title":"Towards Neural Scaling Laws on Graphs","created":"2024-02-03","cited_by_count":13,"area":null},{"id":"2302.05823","title":"Data efficiency and extrapolation trends in neural network interatomic potentials","created":"2023-02-12","cited_by_count":10,"area":null},{"id":"2212.05956","title":"Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging","created":"2022-12-12","cited_by_count":9,"area":"distill"},{"id":"2306.03440","title":"Quantifying the Variability Collapse of Neural Networks","created":"2023-06-06","cited_by_count":9,"area":null},{"id":"2311.01200","title":"Continual Learning Under Language Shift","created":"2023-11-02","cited_by_count":9,"area":null},{"id":"2405.20439","title":"Sharpness-Aware Minimization Enhances Feature Quality via Balanced Learning","created":"2024-05-30","cited_by_count":9,"area":null},{"id":"2404.02154","title":"Dynamic Pre-training: Towards Efficient and Scalable All-in-One Image Restoration","created":"2024-04-02","cited_by_count":8,"area":null},{"id":"2405.11577","title":"A Multi-Perspective Analysis of Memorization in Large Language Models","created":"2024-05-19","cited_by_count":8,"area":null},{"id":"2406.01899","title":"Cross-Domain Graph Data Scaling: A Showcase with Diffusion Models","created":"2024-06-04","cited_by_count":8,"area":"diffusion"},{"id":"2207.10341","title":"UFO: Unified Feature Optimization","created":"2022-07-21","cited_by_count":7,"area":null},{"id":"2304.11718","title":"No Free Lunch in Self Supervised Representation Learning","created":"2023-04-23","cited_by_count":7,"area":null},{"id":"2308.11677","title":"An Analysis of Initial Training Strategies for Exemplar-Free Class-Incremental Learning","created":"2023-08-22","cited_by_count":7,"area":null},{"id":"2403.00194","title":"Ask Your Distribution Shift if Pre-Training is Right for You","created":"2024-02-29","cited_by_count":7,"area":null},{"id":"2505.14705","title":"Beyond Modality Collapse: Representations Blending for Multimodal Dataset Distillation","created":"2025-05-16","cited_by_count":7,"area":null},{"id":"2209.14969","title":"Transfer Learning with Pretrained Remote Sensing Transformers","created":"2022-09-28","cited_by_count":6,"area":null},{"id":"2210.00662","title":"Under the Cover Infant Pose Estimation using Multimodal Data","created":"2022-10-03","cited_by_count":6,"area":null},{"id":"2111.13675","title":"Weakly-guided Self-supervised Pretraining for Temporal Activity Detection","created":"2021-11-26","cited_by_count":5,"area":null},{"id":"2204.08226","title":"Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey","created":"2022-04-18","cited_by_count":5,"area":null},{"id":"2304.02263","title":"Towards Efficient Task-Driven Model Reprogramming with Foundation Models","created":"2023-04-05","cited_by_count":5,"area":null},{"id":"2502.12051","title":"How to Upscale Neural Networks with Scaling Law? A Survey and Practical Guidelines","created":"2025-02-17","cited_by_count":5,"area":null},{"id":"2505.00985","title":"Position: Enough of Scaling LLMs! Lets Focus on Downscaling","created":"2025-05-02","cited_by_count":5,"area":null},{"id":"2506.00288","title":"Emergent Abilities of Large Language Models under Continued Pretraining for Language Adaptation","created":"2025-05-30","cited_by_count":5,"area":null},{"id":"2507.00004","title":"A Theory of Inference Compute Scaling: Reasoning through Directed Stochastic Skill Search","created":"2025-06-10","cited_by_count":5,"area":"lr"},{"id":"2212.06595","title":"OAMixer: Object-aware Mixing Layer for Vision Transformers","created":"2022-12-13","cited_by_count":4,"area":null},{"id":"2303.01598","title":"A Meta-Learning Approach to Predicting Performance and Data Requirements","created":"2023-03-02","cited_by_count":4,"area":null},{"id":"2506.14126","title":"From Memorization to Parameter Interference: How Overtraining Experts Harms Model Merging","created":"2025-06-17","cited_by_count":4,"area":null},{"id":"2509.13240","title":"Don't Forget the Nonlinearity: Unlocking Activation Functions in Efficient Fine-Tuning","created":"2025-09-16","cited_by_count":4,"area":null},{"id":"2602.11137","title":"Weight Decay Improves Language Model Plasticity","created":"2026-02-11","cited_by_count":4,"area":null},{"id":"2208.09529","title":"Intersection of Parallels as an Early Stopping Criterion","created":"2022-08-19","cited_by_count":3,"area":null},{"id":"2211.16299","title":"Transferability Estimation Based On Principal Gradient Expectation","created":"2022-11-29","cited_by_count":3,"area":null},{"id":"2409.14705","title":"Target-Aware Language Modeling via Granular Data Sampling","created":"2024-09-23","cited_by_count":3,"area":null},{"id":"2411.18412","title":"Adaptive Blind All-in-One Image Restoration","created":"2024-11-27","cited_by_count":3,"area":null},{"id":"2510.02228","title":"xLSTM Scaling Laws: Competitive Performance with Linear Time-Complexity","created":"2025-10-02","cited_by_count":3,"area":null},{"id":"2204.03731","title":"GreaseVision: Rewriting the Rules of the Interface","created":"2022-04-07","cited_by_count":2,"area":null},{"id":"2406.10426","title":"MiNT: Multi-Network Training for Transfer Learning on Temporal Graphs","created":"2024-06-14","cited_by_count":2,"area":null},{"id":"2406.18562","title":"Views Can Be Deceiving: Improved SSL Through Feature Space Augmentation","created":"2024-05-28","cited_by_count":2,"area":null},{"id":"2508.04645","title":"A Scalable Pretraining Framework for Link Prediction with Efficient Adaptation","created":"2025-08-06","cited_by_count":2,"area":"moe"},{"id":"2509.16491","title":"FairTune: A Bias-Aware Fine-Tuning Framework Towards Fair Heart Rate Prediction from PPG","created":"2025-09-20","cited_by_count":2,"area":null},{"id":"2510.16743","title":"Zero-Shot Performance Prediction for Probabilistic Scaling Laws","created":"2025-10-19","cited_by_count":2,"area":null},{"id":"2306.02947","title":"Continual Learning with Pretrained Backbones by Tuning in the Input Space","created":"2023-06-05","cited_by_count":1,"area":null},{"id":"2308.01328","title":"A vision transformer-based framework for knowledge transfer from multi-modal to mono-modal lymphoma subtyping models","created":"2023-08-02","cited_by_count":1,"area":null},{"id":"2407.04325","title":"Understanding the Role of Invariance in Transfer Learning","created":"2024-07-05","cited_by_count":1,"area":null},{"id":"2407.19823","title":"Analyzing and reducing the synthetic-to-real transfer gap in Music Information Retrieval: the task of automatic drum transcription","created":"2024-07-29","cited_by_count":1,"area":null},{"id":"2410.05762","title":"Guided Self-attention: Find the Generalized Necessarily Distinct Vectors for Grain Size Grading","created":"2024-10-08","cited_by_count":1,"area":null},{"id":"2505.23032","title":"Bayesian Neural Scaling Law Extrapolation with Prior-Data Fitted Networks","created":"2025-05-29","cited_by_count":1,"area":null},{"id":"2508.09691","title":"PaCo-FR: Patch-Pixel Aligned End-to-End Codebook Learning for Facial Representation Pre-training","created":"2025-08-13","cited_by_count":1,"area":null},{"id":"2210.03261","title":"Adversarial Lagrangian Integrated Contrastive Embedding for Limited Size Datasets","created":"2022-10-06","cited_by_count":0,"area":null},{"id":"2211.03756","title":"Changes from Classical Statistics to Modern Statistics and Data Science","created":"2022-10-30","cited_by_count":0,"area":"diffusion"},{"id":"2211.08005","title":"Cross-Reality Re-Rendering: Manipulating between Digital and Physical Realities","created":"2022-11-15","cited_by_count":0,"area":null},{"id":"2309.05256","title":"Examining the Effect of Pre-training on Time Series Classification","created":"2023-09-11","cited_by_count":0,"area":null}],"next_cursor":"100"}