{"list":"other","total":142,"rows":[{"id":"2010.11929","title":"An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale","created":"2020-10-22","cited_by_count":30186},{"id":"2103.14030","title":"Swin Transformer: Hierarchical Vision Transformer using Shifted Windows","created":"2021-03-25","cited_by_count":12139},{"id":"1503.02531","title":"Distilling the Knowledge in a Neural Network","created":"2015-03-09","cited_by_count":10324},{"id":"2312.00752","title":"Mamba: Linear-Time Sequence Modeling with Selective State Spaces","created":"2023-12-01","cited_by_count":4718},{"id":"2111.00396","title":"Efficiently Modeling Long Sequences with Structured State Spaces","created":"2021-10-31","cited_by_count":2465},{"id":"2102.12122","title":"Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions","created":"2021-02-24","cited_by_count":1962},{"id":"2001.04451","title":"Reformer: The Efficient Transformer","created":"2020-01-13","cited_by_count":1668},{"id":"2006.05525","title":"Knowledge Distillation: A Survey","created":"2020-06-09","cited_by_count":1603},{"id":"2009.14794","title":"Rethinking Attention with Performers","created":"2020-09-30","cited_by_count":1601},{"id":"2006.04768","title":"Linformer: Self-Attention with Linear Complexity","created":"2020-06-08","cited_by_count":1474},{"id":"2105.01601","title":"MLP-Mixer: An all-MLP Architecture for Vision","created":"2021-05-04","cited_by_count":1446},{"id":"2101.11986","title":"Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet","created":"2021-01-28","cited_by_count":1101},{"id":"2210.09461","title":"Token Merging: Your ViT But Faster","created":"2022-10-17","cited_by_count":1021},{"id":"2101.01169","title":"Transformers in Vision: A Survey","created":"2021-01-04","cited_by_count":1013},{"id":"2103.15808","title":"CvT: Introducing Convolutions to Vision Transformers","created":"2021-03-29","cited_by_count":947},{"id":"2106.02034","title":"DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification","created":"2021-06-03","cited_by_count":864},{"id":"2103.14899","title":"CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification","created":"2021-03-27","cited_by_count":806},{"id":"2110.02178","title":"MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer","created":"2021-10-05","cited_by_count":642},{"id":"2103.00112","title":"Transformer in Transformer","created":"2021-02-27","cited_by_count":633},{"id":"1909.01377","title":"Deep Equilibrium Models","created":"2019-09-03","cited_by_count":615},{"id":"2104.13840","title":"Twins: Revisiting the Design of Spatial Attention in Vision Transformers","created":"2021-04-28","cited_by_count":565},{"id":"2205.08534","title":"Vision Transformer Adapter for Dense Predictions","created":"2022-05-17","cited_by_count":565},{"id":"2107.00652","title":"CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows","created":"2021-07-01","cited_by_count":527},{"id":"2111.11418","title":"MetaFormer Is Actually What You Need for Vision","created":"2021-11-22","cited_by_count":524},{"id":"2102.10882","title":"Conditional Positional Encodings for Vision Transformers","created":"2021-02-22","cited_by_count":406},{"id":"2105.08050","title":"Pay Attention to MLPs","created":"2021-05-17","cited_by_count":368},{"id":"2202.07800","title":"Not All Patches are What You Need: Expediting Vision Transformers via Token Reorganizations","created":"2022-02-16","cited_by_count":363},{"id":"2112.07658","title":"AdaViT: Adaptive Tokens for Efficient Vision Transformer","created":"2021-12-14","cited_by_count":362},{"id":"2103.16302","title":"Rethinking Spatial Dimensions of Vision Transformers","created":"2021-03-30","cited_by_count":361},{"id":"2105.03404","title":"ResMLP: Feedforward networks for image classification with data-efficient training","created":"2021-05-07","cited_by_count":339},{"id":"2306.00989","title":"Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles","created":"2023-06-01","cited_by_count":290},{"id":"2107.00641","title":"Focal Self-attention for Local-Global Interactions in Vision Transformers","created":"2021-07-01","cited_by_count":288},{"id":"2206.13947","title":"Long Range Language Modeling via Gated State Spaces","created":"2022-06-27","cited_by_count":265},{"id":"2303.14389","title":"MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizer","created":"2023-03-25","cited_by_count":262},{"id":"2107.00645","title":"Global Filter Networks for Image Classification","created":"2021-07-01","cited_by_count":260},{"id":"1910.10073","title":"Depth-Adaptive Transformer","created":"2019-10-22","cited_by_count":236},{"id":"2403.13298","title":"Rotary Position Embedding for Vision Transformer","created":"2024-03-20","cited_by_count":236},{"id":"2108.05895","title":"Mobile-Former: Bridging MobileNet and Transformer","created":"2021-08-12","cited_by_count":235},{"id":"2207.10666","title":"TinyViT: Fast Pretraining Distillation for Small Vision Transformers","created":"2022-07-21","cited_by_count":234},{"id":"2111.15668","title":"AdaViT: Adaptive Vision Transformers for Efficient Image Recognition","created":"2021-11-30","cited_by_count":228},{"id":"2103.15358","title":"Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding","created":"2021-03-29","cited_by_count":207},{"id":"1412.6553","title":"Speeding-up Convolutional Neural Networks Using Fine-tuned CP-Decomposition","created":"2014-12-19","cited_by_count":203},{"id":"2108.01390","title":"Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer","created":"2021-08-03","cited_by_count":177},{"id":"2305.07027","title":"EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention","created":"2023-05-11","cited_by_count":172},{"id":"2308.00442","title":"FLatten Transformer: Vision Transformer using Focused Linear Attention","created":"2023-08-01","cited_by_count":171},{"id":"2112.13890","title":"SPViT: Enabling Faster Vision Transformers via Soft Token Pruning","created":"2021-12-27","cited_by_count":167},{"id":"2106.13112","title":"VOLO: Vision Outlooker for Visual Recognition","created":"2021-06-24","cited_by_count":165},{"id":"2206.02680","title":"Separable Self-attention for Mobile Vision Transformers","created":"2022-06-06","cited_by_count":163},{"id":"2303.08810","title":"BiFormer: Vision Transformer with Bi-Level Routing Attention","created":"2023-03-15","cited_by_count":151},{"id":"2403.09977","title":"EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba","created":"2024-03-15","cited_by_count":146},{"id":"2212.08254","title":"RepQ-ViT: Scale Reparameterization for Post-Training Quantization of Vision Transformers","created":"2022-12-16","cited_by_count":137},{"id":"2106.02852","title":"Patch Slimming for Efficient Vision Transformers","created":"2021-06-05","cited_by_count":133},{"id":"2111.11429","title":"Benchmarking Detection Transfer Learning with Vision Transformers","created":"2021-11-22","cited_by_count":131},{"id":"2106.12620","title":"IA-RED$^2$: Interpretability-Aware Redundancy Reduction for Vision Transformers","created":"2021-06-23","cited_by_count":127},{"id":"2107.10224","title":"CycleMLP: A MLP-like Architecture for Dense Prediction","created":"2021-07-21","cited_by_count":126},{"id":"2312.01026","title":"Token Fusion: Bridging the Gap between Token Pruning and Token Merging","created":"2023-12-02","cited_by_count":125},{"id":"2312.02139","title":"DiffiT: Diffusion Vision Transformers for Image Generation","created":"2023-12-04","cited_by_count":106},{"id":"2107.08391","title":"AS-MLP: An Axial Shifted MLP Architecture for Vision","created":"2021-07-18","cited_by_count":101},{"id":"2204.08680","title":"Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformer","created":"2022-04-19","cited_by_count":101},{"id":"2305.07011","title":"Region-Aware Pretraining for Open-Vocabulary Object Detection with Vision Transformers","created":"2023-05-11","cited_by_count":91},{"id":"2111.15193","title":"Shunted Self-Attention via Multi-Scale Token Aggregation","created":"2021-11-30","cited_by_count":90},{"id":"2307.02628","title":"SkipDecode: Autoregressive Skip Decoding with Batching and Caching for Efficient LLM Inference","created":"2023-07-05","cited_by_count":89},{"id":"2106.07477","title":"S$^2$-MLP: Spatial-Shift MLP Architecture for Vision","created":"2021-06-14","cited_by_count":83},{"id":"2204.05525","title":"TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentation","created":"2022-04-12","cited_by_count":82},{"id":"2304.10716","title":"Joint Token Pruning and Squeezing Towards More Aggressive Compression of Vision Transformers","created":"2023-04-21","cited_by_count":81},{"id":"2102.02973","title":"Show, Attend and Distill:Knowledge Distillation via Attention-based Feature Matching","created":"2021-02-05","cited_by_count":79},{"id":"2310.19444","title":"One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation","created":"2023-10-30","cited_by_count":78},{"id":"2305.17997","title":"DiffRate : Differentiable Compression Rate for Efficient Vision Transformers","created":"2023-05-29","cited_by_count":77},{"id":"2103.14636","title":"A Practical Survey on Faster and Lighter Transformers","created":"2021-03-26","cited_by_count":73},{"id":"2305.03273","title":"Semantic Segmentation using Vision Transformers: A survey","created":"2023-05-05","cited_by_count":73},{"id":"2303.13005","title":"From Knowledge Distillation to Self-Knowledge Distillation: A Unified Approach with Normalized Loss and Customized Soft Labels","created":"2023-03-23","cited_by_count":69},{"id":"2303.04935","title":"X-Pruner: eXplainable Pruning for Vision Transformers","created":"2023-03-08","cited_by_count":68},{"id":"2108.13341","title":"Hire-MLP: Vision MLP via Hierarchical Rearrangement","created":"2021-08-30","cited_by_count":66},{"id":"2303.15446","title":"SwiftFormer: Efficient Additive Attention for Transformer-based Real-time Mobile Vision Applications","created":"2023-03-27","cited_by_count":66},{"id":"2202.12015","title":"Learning to Merge Tokens in Vision Transformers","created":"2022-02-24","cited_by_count":65},{"id":"2204.12997","title":"DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers","created":"2022-04-27","cited_by_count":65},{"id":"2203.03821","title":"CF-ViT: A General Coarse-to-Fine Method for Vision Transformer","created":"2022-03-08","cited_by_count":63},{"id":"2112.12782","title":"SeMask: Semantically Masked Transformers for Semantic Segmentation","created":"2021-12-23","cited_by_count":55},{"id":"2306.11369","title":"CrossKD: Cross-Head Knowledge Distillation for Object Detection","created":"2023-06-20","cited_by_count":52},{"id":"2205.13515","title":"Green Hierarchical Vision Transformer for Masked Image Modeling","created":"2022-05-26","cited_by_count":50},{"id":"2412.10137","title":"Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments","created":"2024-12-13","cited_by_count":50},{"id":"2205.13137","title":"MixMAE: Mixed and Masked Autoencoder for Efficient Pretraining of Hierarchical Vision Transformers","created":"2022-05-26","cited_by_count":47},{"id":"2211.08110","title":"HeatViT: Hardware-Efficient Adaptive Token Pruning for Vision Transformers","created":"2022-11-15","cited_by_count":46},{"id":"2309.01692","title":"Mask-Attention-Free Transformer for 3D Instance Segmentation","created":"2023-09-04","cited_by_count":46},{"id":"2504.12636","title":"A0: An Affordance-Aware Hierarchical Model for General Robotic Manipulation","created":"2025-04-17","cited_by_count":45},{"id":"2111.15127","title":"A Unified Pruning Framework for Vision Transformers","created":"2021-11-30","cited_by_count":40},{"id":"2112.04840","title":"Knowledge Distillation for Object Detection via Rank Mimicking and Prediction-guided Feature Imitation","created":"2021-12-09","cited_by_count":40},{"id":"2504.02477","title":"Multimodal Fusion and Vision-Language Models: A Survey for Robot Vision","created":"2025-04-03","cited_by_count":40},{"id":"1907.06119","title":"Understanding Deep Learning Techniques for Image Segmentation","created":"2019-07-13","cited_by_count":38},{"id":"2404.07236","title":"Lightweight Deep Learning for Resource-Constrained Environments: A Survey","created":"2024-04-08","cited_by_count":38},{"id":"2109.04454","title":"ConvMLP: Hierarchical Convolutional MLPs for Vision","created":"2021-09-09","cited_by_count":37},{"id":"2402.11148","title":"Knowledge Distillation Based on Transformed Teacher Matching","created":"2024-02-17","cited_by_count":37},{"id":"2203.06345","title":"The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy","created":"2022-03-12","cited_by_count":35},{"id":"2403.16536","title":"VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecasting","created":"2024-03-25","cited_by_count":35},{"id":"2106.03180","title":"Vision Transformers with Hierarchical Attention","created":"2021-06-06","cited_by_count":31},{"id":"2308.00255","title":"LGViT: Dynamic Early Exiting for Accelerating Vision Transformer","created":"2023-08-01","cited_by_count":31},{"id":"2106.15183","title":"Multi-Exit Vision Transformer for Dynamic Inference","created":"2021-06-29","cited_by_count":28},{"id":"2105.09121","title":"Single-Layer Vision Transformers for More Accurate Early Exits with Less Overhead","created":"2021-05-19","cited_by_count":26},{"id":"2305.03595","title":"HSCNet++: Hierarchical Scene Coordinate Classification and Regression for Visual Localization with Transformer","created":"2023-05-05","cited_by_count":26},{"id":"2305.05010","title":"Do Not Blindly Imitate the Teacher: Using Perturbed Loss for Knowledge Distillation","created":"2023-05-08","cited_by_count":25}],"next_cursor":"100"}