Local Relation Networks for Image Recognition
Not on the map. Why?
Abstract (arXiv)
The convolution layer has been the dominant feature extractor in computer vision for years. However, the spatial aggregation in convolution is basically a pattern matching process that applies fixed filters which are inefficient at modeling visual elements with varying spatial distributions. This paper presents a new image feature extractor, called the local relation layer, that adaptively determines aggregation weights based on the compositional relationship of local pixel pairs. With this relational approach, it can composite visual elements into higher-level entities in a more efficient manner that benefits semantic inference. A network built with local relation layers, called the Local Relation Network (LR-Net), is found to provide greater modeling capacity than its counterpart built with regular convolution on large-scale recognition tasks such as ImageNet classification.
Key facts. Cited by 210 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 93; 2022: 66; 2023: 28; 2024: 16; 2025: 6; 2026: 1.
210 papers.
Sort:
By area:
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
- 2021Video Swin Transformercited by 1,090
- 2021Transformers in Vision: A Surveycited by 1,009
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
- 2021Multiscale Vision Transformerscited by 896
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2021Intriguing Properties of Vision Transformerscited by 446
- 2021VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Textcited by 427
38 more
- 2021Bottleneck Transformers for Visual Recognitioncited by 364
- 2022Not All Patches are What You Need: Expediting Vision Transformers via Token Reorganizationscited by 359
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2021DeepViT: Towards Deeper Vision Transformercited by 288
- 2021Escaping the Big Data Paradigm with Compact Transformerscited by 261
- 2021Incorporating Convolution Designs into Visual Transformerscited by 248
- 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
- 2021Co-Scale Conv-Attentional Image Transformerscited by 224
- 2021Scaling Local Self-Attention for Parameter Efficient Visual Backbonescited by 220
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2021UniT: Multimodal Multitask Learning with a Unified Transformercited by 195
- 2022Focal Modulation Networkscited by 186
- 2021VOLO: Vision Outlooker for Visual Recognitioncited by 164
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
- 2021Revisiting ResNets: Improved Training and Scaling Strategiescited by 158
- 2022Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNscited by 155
- 2021StyleSwin: Transformer-based GAN for High-resolution Image Generationcited by 152
- 2021HRFormer: High-Resolution Transformer for Dense Predictioncited by 149
- 2021Visformer: The Vision-friendly Transformercited by 137
- 2023Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networkscited by 129
- 2021RegionViT: Regional-to-Local Attention for Vision Transformerscited by 126
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2021Video Frame Interpolation Transformercited by 122
- 2021Generative Adversarial Transformerscited by 120
- 2021A Survey of Visual Transformerscited by 117
- 2021Shuffle Transformer: Rethinking Spatial Shuffle for Vision Transformercited by 115
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2021LambdaNetworks: Modeling Long-Range Interactions Without Attentioncited by 107
- 2021Efficient Training of Visual Transformers with Small Datasetscited by 107
- 2022Vision Transformer for NeRF-Based View Synthesis from a Single Input Imagecited by 104
- 2021Variational Relational Point Completion Networkcited by 103
- 2021Vision Permutator: A Permutable MLP-Like Architecture for Visual Recognitioncited by 103
- 2021Fast Point Transformercited by 103
- 2021Involution: Inverting the Inherence of Convolution for Visual Recognitioncited by 99
- 2021Contextual Transformer Networks for Visual Recognitioncited by 90
- 2022Accurate Image Restoration with Attention Retractable Transformercited by 85
- 2021Scalable Vision Transformers with Hierarchical Poolingcited by 84
50 most cited of 210 All 210 (JSON)
- 2026CoFusion: Multispectral and Hyperspectral Image Fusion via Spectral Coordinate Attention12 Apr 2026
- 2025Region-Aware Deformable Convolutions18 Sep 2025
- 2025MSMA: Multi-Scale Feature Fusion For Multi-Attribute 3D Face Reconstruction From Unconstrained Images15 Sep 2025
- 2025MambaVesselNet++: A Hybrid CNN-Mamba Architecture for Medical Image Segmentation26 Jul 2025
- 2025RDD: Robust Feature Detector and Descriptor using Deformable Transformer12 May 2025
- 2025DFEN: Dual Feature Equalization Network for Medical Image Segmentation9 May 2025
- 2025MB-TaylorFormer V2: Improved Multi-branch Linear Transformer Expanded by Taylor Formula for Image Restoration8 Jan 2025
- 2024Rethinking Normalization Strategies and Convolutional Kernels for Multimodal Image Fusion15 Nov 2024
- 2024SIRA: Scalable Inter-frame Relation and Association for Radar Perception4 Nov 2024
- 2024ContextDet: Temporal Action Detection with Adaptive Context Aggregation20 Oct 2024
- 2024Scaling Up Your Kernels: Large Kernel Design in ConvNets towards Universal Representations10 Oct 2024
- 2024BA-Net: Bridge Attention in Deep Neural Networks10 Oct 2024
38 more
- 2024MCPDepth: Omnidirectional Depth Estimation via Stereo Matching from Multi-Cylindrical Panoramas3 Aug 2024
- 2024An Experimental Study on Exploring Strong Lightweight Vision Transformers via Masked Image Modeling Pre-Training18 Apr 2024
- 2024Progressive Semantic-Guided Vision Transformer for Zero-Shot Learning11 Apr 2024
- 2024Learning Correlation Structures for Vision Transformers5 Apr 2024
- 2024Harnessing The Power of Attention For Patch-Based Biomedical Image Classification1 Apr 2024
- 2024Enhancing Video Transformers for Action Understanding with VLM-aided Training24 Mar 2024
- 2024LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernels22 Mar 2024
- 2024Leveraging Large Language Model-based Room-Object Relationships Knowledge for Enhancing Multimodal-Input Object Goal Navigation21 Mar 2024
- 2024Harmonious Group Choreography with Trajectory-Controllable Diffusion10 Mar 2024
- 2024PMFSNet: Polarized Multi-scale Feature Self-attention Network For Lightweight Medical Image Segmentation15 Jan 2024
- 2024Improving Diffusion-Based Image Synthesis with Context Prediction4 Jan 2024
- 2023DocMSU: A Comprehensive Benchmark for Document-level Multimodal Sarcasm Understanding26 Dec 2023
- 2023Integrating Human Vision Perception in Vision Transformers for Classifying Waste Items19 Dec 2023
- 2023UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition27 Nov 2023
- 2023Investigating Relative Performance of Transfer and Meta Learning31 Oct 2023
- 2023Large Separable Kernel Attention: Rethinking the Large Kernel Attention Design in CNN4 Sep 2023
- 2023PanoSwin: a Pano-style Swin Transformer for Panorama Understanding28 Aug 2023
- 2023MB-TaylorFormer: Multi-branch Efficient Transformer Expanded by Taylor Formula for Image Dehazing27 Aug 2023
- 2023Real-time Automatic M-mode Echocardiography Measurement with Panel Attention from Local-to-Global Pixels15 Aug 2023
- 2023SCSC: Spatial Cross-scale Convolution Module to Strengthen both CNNs and Transformers14 Aug 2023
- 2023DETR Doesn't Need Multi-Scale or Locality Design3 Aug 2023
- 2023Benchmarking Ultra-High-Definition Image Reflection Removal1 Aug 2023
- 20233DRP-Net: 3D Relative Position-aware Network for 3D Visual Grounding25 Jul 2023
- 2023Digital Modeling on Large Kernel Metamaterial Neural Network21 Jul 2023
- 2023Dual-view Correlation Hybrid Attention Network for Robust Holistic Mammogram Classification19 Jun 2023
- 2023Multi-level Multiple Instance Learning with Transformer for Whole Slide Image Classification8 Jun 2023
- 2023Evolution: A Unified Formula for Feature Operators from a High-level Perspective23 May 2023
- 2023Semantic Segmentation using Vision Transformers: A survey5 May 2023
- 2023Point Transformer For Coronary Artery Labeling4 May 2023
- 2023Early Detection of Alzheimer's Disease using Bottleneck Transformers1 May 2023
- 2023Transformer-Based Visual Segmentation: A Survey19 Apr 2023
- 2023Variational Relational Point Completion Network for Robust 3D Classification18 Apr 2023
- 2023DynaMITe: Dynamic Query Bootstrapping for Multi-object Interactive Segmentation Transformer13 Apr 2023
- 2023Dual Cross-Attention for Medical Image Segmentation30 Mar 2023
- 2023Self-positioning Point-based Transformer for Point Cloud Understanding29 Mar 2023
- 2023Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks7 Mar 2023
- 2023Are More Layers Beneficial to Graph Transformers?1 Mar 2023
- 2023Hyneter: Hybrid Network Transformer for Object Detection18 Feb 2023
50 newest of 210 All 210 (JSON)
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
- 2021Video Swin Transformercited by 1,090
- 2021Transformers in Vision: A Surveycited by 1,009
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
- 2021Multiscale Vision Transformerscited by 896
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2021Intriguing Properties of Vision Transformerscited by 446
- 2021VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Textcited by 427
12 most cited of 208 All 208 (JSON)
- 2026CoFusion: Multispectral and Hyperspectral Image Fusion via Spectral Coordinate Attention12 Apr 2026
- 2025Region-Aware Deformable Convolutions18 Sep 2025
- 2025MSMA: Multi-Scale Feature Fusion For Multi-Attribute 3D Face Reconstruction From Unconstrained Images15 Sep 2025
- 2025RDD: Robust Feature Detector and Descriptor using Deformable Transformer12 May 2025
- 2025DFEN: Dual Feature Equalization Network for Medical Image Segmentation9 May 2025
- 2025MB-TaylorFormer V2: Improved Multi-branch Linear Transformer Expanded by Taylor Formula for Image Restoration8 Jan 2025
- 2024Rethinking Normalization Strategies and Convolutional Kernels for Multimodal Image Fusion15 Nov 2024
- 2024SIRA: Scalable Inter-frame Relation and Association for Radar Perception4 Nov 2024
- 2024ContextDet: Temporal Action Detection with Adaptive Context Aggregation20 Oct 2024
- 2024Scaling Up Your Kernels: Large Kernel Design in ConvNets towards Universal Representations10 Oct 2024
- 2024BA-Net: Bridge Attention in Deep Neural Networks10 Oct 2024
- 2024MCPDepth: Omnidirectional Depth Estimation via Stereo Matching from Multi-Cylindrical Panoramas3 Aug 2024
12 newest of 208 All 208 (JSON)