RecycleLoRA: Rank-Revealing QR-Based Dual-LoRA Subspace Adaptation for Domain Generalized Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
Domain Generalized Semantic Segmentation (DGSS) aims to maintain robust performance across unseen target domains. Vision Foundation Models (VFMs) offer rich multi-domain knowledge that can enhance generalization. However, strategies for actively exploiting the rich subspace structures within VFMs remain under-explored, with many existing methods focusing primarily on preserving pre-trained knowledge. Furthermore, their LoRA components often suffer from limited representational diversity and inefficient parameter utilization. We propose RecycleLoRA, which addresses both challenges by employing Rank-Revealing QR Decomposition (RRQR) to systematically exploit VFM's subspace structures and enhance LoRA's representational richness. Our main adapter leverages minor subspace directions identified by RRQR to learn diverse and independent features, achieving competitive performance even when used alone. We further introduce a sub adapter that carefully refines major directions with minimal adjustments, providing complementary improvements to the main adapter's strong baseline performance. This design enables the dual adapters to learn distinct representations without requiring additional regularization losses. Our systematic exploitation of pre-trained subspace structures through RRQR-based initialization leads to superior domain generalization performance. RecycleLoRA achieves state-of-the-art performance on both synthetic-to-real generalization and real-to-real generalization tasks without complex architectures or additional inference latency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 61 of its 77 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
61 of 77 references.
References · 61
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
- 2022Visual Prompt Tuningcited by 1,674
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
- 2016Pruning Filters for Efficient ConvNetscited by 1,129
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
38 more
- 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
- 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 740
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
- 2023EVA-02: A Visual Representation for Neon Genesiscited by 377
- 2018Two at Once: Enhancing Learning and Generalization Capacities via IBN-Netcited by 361
- 2022Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuningcited by 292
- 2024PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Modelscited by 261
- 2021RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whiteningcited by 213
- 2023ReLoRA: High-Rank Training Through Low-Rank Updatescited by 200
- 2021Learning to Diversify for Single Domain Generalizationcited by 170
- 2020Layer-adaptive sparsity for the Magnitude-based Pruningcited by 122
- 2023Sparse Low-rank Adaptation of Pre-trained Language Modelscited by 96
- 2023Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic Segmentationcited by 82
- 2022Semantic-Aware Domain Generalized Segmentationcited by 78
- 2022WildNet: Learning Domain Generalized Semantic Segmentation from the Wildcited by 75
- 2022Adversarial Style Augmentation for Domain Generalized Urban-Scene Segmentationcited by 69
- 2021Global and Local Texture Randomization for Synthetic-to-Real Semantic Segmentationcited by 56
- 2022Rank Diminishing in Deep Neural Networkscited by 47
- 2023DGInStyle: Domain-Generalizable Semantic Segmentation with Image Diffusion Models and Stylized Semantic Controlcited by 44
- 2023All for One, and One for All: UrbanSyn Dataset, the third Musketeer of Synthetic Driving Scenescited by 40
- 2022PASTA: Proportional Amplitude Spectrum Training Augmentation for Syn-to-Real Domain Generalizationcited by 38
- 2023LoRAShear: Efficient Large Language Model Structured Pruning and Knowledge Recoverycited by 37
- 2023Collaborating Foundation Models for Domain Generalized Semantic Segmentationcited by 33
- 2023HGFormer: Hierarchical Grouping Transformer for Domain Generalized Semantic Segmentationcited by 31
- 2020Convolution-Weight-Distribution Assumption: Rethinking the Criteria of Channel Pruningcited by 29
- 2022Attention Diversification for Domain Generalizationcited by 29
- 2023Learning Content-enhanced Mask Transformer for Domain Generalized Urban-Scene Segmentationcited by 29
- 2023A Simple Recipe for Language-guided Domain Generalized Segmentationcited by 27
- 2023Generalization by Adaptation: Diffusion-Based Domain Extension for Domain-Generalized Semantic Segmentationcited by 27
- 2020Lottery Tickets in Linear Models: An Analysis of Iterative Magnitude Pruningcited by 23
- 2023Texture Learning Domain Randomization for Domain Generalized Segmentationcited by 23
- 2025Mamba as a Bridge: Where Vision Foundation Models Meet Vision Language Models for Domain-Generalized Semantic Segmentationcited by 23
- 2024SoMA: Singular Value Decomposed Minor Components Adaptation for Domain Generalizable Representation Learningcited by 22
- 2024Learning Spectral-Decomposed Tokens for Domain Generalized Semantic Segmentationcited by 21
- 2023Strong but simple: A Baseline for Domain Generalized Dense Perception by CLIP-based Transfer Learningcited by 20
- 2024Textual Query-Driven Mask Transformer for Domain Generalized Segmentationcited by 20
- 2020Increasing the Robustness of Semantic Segmentation Models with Painting-by-Numberscited by 17
- 2024Style Blind Domain Generalized Semantic Segmentation via Covariance Alignment and Semantic Consistence Contrastive Learningcited by 17
50 most cited of 61 All 61 (JSON)
Built on by
Not cited yet.