Spatially-Adaptive Gradient Re-parameterization for 3D Large Kernel Optimization
Not on the map. Why?
Abstract (arXiv)
Large kernel convolutions offer a scalable alternative to vision transformers for high-resolution 3D volumetric analysis, yet naively increasing kernel size often leads to optimization instability. Motivated by the spatial bias inherent in effective receptive fields (ERFs), we theoretically demonstrate that structurally re-parameterized blocks induce spatially varying learning rates that are crucial for convergence. Leveraging this insight, we introduce Rep3D, a framework that employs a lightweight modulation network to generate receptive-biased scaling masks, adaptively re-weighting kernel updates within a plain encoder architecture. This approach unifies spatial inductive bias with optimization-aware learning, avoiding the complexity of multi-branch designs while ensuring robust local-to-global convergence. Extensive evaluations on five 3D segmentation benchmarks demonstrate that Rep3D consistently outperforms state-of-the-art transformer and fixed-prior baselines. The source code is publicly available at https://github.com/leeh43/Rep3D.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 27 references that are in the map. First posted on arXiv 26 May 2025.
Builds on
19 of 27 references.
References · 19
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022A ConvNet for the 2020scited by 3,579
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 830
- 2021The Medical Segmentation Decathloncited by 628
- 2021RepVGG: Making VGG-style ConvNets Great Againcited by 522
- 2022AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentationcited by 351
- 20183D MRI brain tumor segmentation using autoencoder regularizationcited by 328
- 2021TransBTS: Multimodal Brain Tumor Segmentation Using Transformercited by 265
- 2019The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomescited by 172
7 more
- 2022More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsitycited by 142
- 2023STU-Net: Scalable and Transferable Medical Image Segmentation Models Empowered by Large-Scale Supervised Pre-trainingcited by 100
- 20223D UX-Net: A Large Kernel Volumetric ConvNet Modernizing Hierarchical Transformer for Medical Image Segmentationcited by 94
- 2022Re-parameterizing Your Optimizers rather than Architecturescited by 35
- 2024PeLK: Parameter-efficient Large Kernel ConvNets with Peripheral Convolutioncited by 28
- 2023Scaling Up 3D Kernels with Bayesian Frequency Re-parameterization for Medical Image Segmentationcited by 12
- 2020RAP-Net: Coarse-to-Fine Multi-Organ Segmentation with Single Random Anatomical Priorcited by 8
Built on by
Not cited yet.