mlsanityData to 7 Oct 2026

RecycleLoRA: Rank-Revealing QR-Based Dual-LoRA Subspace Adaptation for Domain Generalized Semantic Segmentation

arXiv 2603.28142 ↗First posted 30 Mar 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Domain Generalized Semantic Segmentation (DGSS) aims to maintain robust performance across unseen target domains. Vision Foundation Models (VFMs) offer rich multi-domain knowledge that can enhance generalization. However, strategies for actively exploiting the rich subspace structures within VFMs remain under-explored, with many existing methods focusing primarily on preserving pre-trained knowledge. Furthermore, their LoRA components often suffer from limited representational diversity and inefficient parameter utilization. We propose RecycleLoRA, which addresses both challenges by employing Rank-Revealing QR Decomposition (RRQR) to systematically exploit VFM's subspace structures and enhance LoRA's representational richness. Our main adapter leverages minor subspace directions identified by RRQR to learn diverse and independent features, achieving competitive performance even when used alone. We further introduce a sub adapter that carefully refines major directions with minimal adjustments, providing complementary improvements to the main adapter's strong baseline performance. This design enables the dual adapters to learn distinct representations without requiring additional regularization losses. Our systematic exploitation of pre-trained subspace structures through RRQR-based initialization leads to superior domain generalization performance. RecycleLoRA achieves state-of-the-art performance on both synthetic-to-real generalization and real-to-real generalization tasks without complex architectures or additional inference latency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 61 of its 77 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

61 of 77 references.

References · 61

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  5. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  6. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  7. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  8. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
  9. 2022Visual Prompt Tuningcited by 1,674
  10. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  11. 2016Pruning Filters for Efficient ConvNetscited by 1,129
  12. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
38 more
  1. 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
  2. 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 740
  3. 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
  4. 2023EVA-02: A Visual Representation for Neon Genesiscited by 377
  5. 2018Two at Once: Enhancing Learning and Generalization Capacities via IBN-Netcited by 361
  6. 2022Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuningcited by 292
  7. 2024PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Modelscited by 261
  8. 2021RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whiteningcited by 213
  9. 2023ReLoRA: High-Rank Training Through Low-Rank Updatescited by 200
  10. 2021Learning to Diversify for Single Domain Generalizationcited by 170
  11. 2020Layer-adaptive sparsity for the Magnitude-based Pruningcited by 122
  12. 2023Sparse Low-rank Adaptation of Pre-trained Language Modelscited by 96
  13. 2023Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic Segmentationcited by 82
  14. 2022Semantic-Aware Domain Generalized Segmentationcited by 78
  15. 2022WildNet: Learning Domain Generalized Semantic Segmentation from the Wildcited by 75
  16. 2022Adversarial Style Augmentation for Domain Generalized Urban-Scene Segmentationcited by 69
  17. 2021Global and Local Texture Randomization for Synthetic-to-Real Semantic Segmentationcited by 56
  18. 2022Rank Diminishing in Deep Neural Networkscited by 47
  19. 2023DGInStyle: Domain-Generalizable Semantic Segmentation with Image Diffusion Models and Stylized Semantic Controlcited by 44
  20. 2023All for One, and One for All: UrbanSyn Dataset, the third Musketeer of Synthetic Driving Scenescited by 40
  21. 2022PASTA: Proportional Amplitude Spectrum Training Augmentation for Syn-to-Real Domain Generalizationcited by 38
  22. 2023LoRAShear: Efficient Large Language Model Structured Pruning and Knowledge Recoverycited by 37
  23. 2023Collaborating Foundation Models for Domain Generalized Semantic Segmentationcited by 33
  24. 2023HGFormer: Hierarchical Grouping Transformer for Domain Generalized Semantic Segmentationcited by 31
  25. 2020Convolution-Weight-Distribution Assumption: Rethinking the Criteria of Channel Pruningcited by 29
  26. 2022Attention Diversification for Domain Generalizationcited by 29
  27. 2023Learning Content-enhanced Mask Transformer for Domain Generalized Urban-Scene Segmentationcited by 29
  28. 2023A Simple Recipe for Language-guided Domain Generalized Segmentationcited by 27
  29. 2023Generalization by Adaptation: Diffusion-Based Domain Extension for Domain-Generalized Semantic Segmentationcited by 27
  30. 2020Lottery Tickets in Linear Models: An Analysis of Iterative Magnitude Pruningcited by 23
  31. 2023Texture Learning Domain Randomization for Domain Generalized Segmentationcited by 23
  32. 2025Mamba as a Bridge: Where Vision Foundation Models Meet Vision Language Models for Domain-Generalized Semantic Segmentationcited by 23
  33. 2024SoMA: Singular Value Decomposed Minor Components Adaptation for Domain Generalizable Representation Learningcited by 22
  34. 2024Learning Spectral-Decomposed Tokens for Domain Generalized Semantic Segmentationcited by 21
  35. 2023Strong but simple: A Baseline for Domain Generalized Dense Perception by CLIP-based Transfer Learningcited by 20
  36. 2024Textual Query-Driven Mask Transformer for Domain Generalized Segmentationcited by 20
  37. 2020Increasing the Robustness of Semantic Segmentation Models with Painting-by-Numberscited by 17
  38. 2024Style Blind Domain Generalized Semantic Segmentation via Covariance Alignment and Semantic Consistence Contrastive Learningcited by 17

50 most cited of 61 All 61 (JSON)

Built on by

Not cited yet.