ST-LoRA: Single Trajectory LoRA Ensemble for Uncertainty Aware Agricultural Segmentation
Not on the map. Why?
Abstract (arXiv)
Reliable decision support in digital agriculture requires not only accurate predictions but also well-calibrated uncertainty estimates, particularly for dense prediction tasks such as semantic segmentation. Ensembles provide strong uncertainty quantification but are computationally and memory demanding, while single-model approximations often sacrifice uncertainty quality. We propose ST-LoRA, a parameter-efficient ensemble that builds diverse members from a single training trajectory by combining Low-Rank Adaptation (LoRA) with snapshot ensembling. All members share a frozen pretrained backbone and differ only in lightweight low-rank adapters, which sharply reduces trainable parameters, checkpoint storage, and I/O overhead. We evaluate SegFormer, Mask2Former, and EoMT on GrowliFlower-L (cauliflower, open field) and BUP20 (sweet pepper, glasshouse), covering in-distribution performance, calibration under covariate shift, and near- and far-out-of-distribution (OoD) detection, with BUTom21 (tomato) as near-OoD data. Extensive ablations show that feed-forward layers, not attention projections, are the critical LoRA target for dense prediction, and that the scaling ratio α/r governs an accuracy--calibration trade-off. Against full-rank snapshot ensembles, ST-LoRA is competitive in segmentation quality, with architecture-dependent training time and energy savings. Against MC Dropout, DDU, and six post-hoc calibrators, it achieves the strongest far-OoD image-level detection and near-OoD pixel-level localization with low cross-seed variance, although full-rank ensembles remain better calibrated. These results show that LoRA-based ensembling offers a compelling efficiency--performance trade-off for agricultural vision systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 63 of its 108 references that are in the map. First posted on arXiv 2 Aug 2026.
Builds on
63 of 108 references.
References · 63
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
38 more
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2021Towards a Unified View of Parameter-Efficient Transfer Learningcited by 863
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
- 2021Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depthcited by 411
- 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
- 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 368
- 2017Snapshot Ensembles: Train 1, get M for freecited by 349
- 2024LoRA Learns Less and Forgets Lesscited by 313
- 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
- 2020Training independent subnetworks for robust predictioncited by 177
- 2021A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challengescited by 154
- 2021MoEfication: Transformer Feed-forward Layers are Mixtures of Expertscited by 149
- 2014A Tutorial on Principal Component Analysiscited by 139
- 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
- 2018Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batchescited by 133
- 2022Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning: Are Conditional Entropy and Mutual Information Appropriate Measures?cited by 124
- 2020Local Temperature Scaling for Probability Calibrationcited by 95
- 2021Spectral Normalisation for Deep Reinforcement Learning: an Optimisation Perspectivecited by 64
- 2021Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Boundscited by 64
- 2021On the Practicality of Deterministic Epistemic Uncertaintycited by 62
- 2021Do You Even Need Attention? A Stack of Feed-Forward Layers Does Surprisingly Well on ImageNetcited by 61
- 2025Energy Considerations of Large Language Model Inference and Efficiency Optimizationscited by 54
- 2024Uncertainty quantification in fine-tuned LLMs using LoRA ensemblescited by 35
- 2021Meta-Cal: Well-controlled Post-hoc Calibration by Rankingcited by 33
- 2017Learning Algorithms for Active Learningcited by 30
- 2022When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanismcited by 30
- 2020Evaluating probabilistic classifiers: Reliability diagrams and score decompositions revisitedcited by 25
- 2022On Calibrating Semantic Segmentation Models: Analyses and An Algorithmcited by 25
- 2023Skip-Attention: Improving Vision Transformers by Paying Less Attentioncited by 23
- 2024Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Modelscited by 20
- 2024LoRA-Ensemble: Efficient Uncertainty Modelling for Self-Attention Networkscited by 20
- 2025Understanding Model Calibration -- A gentle introduction and visual exploration of calibration and the expected calibration error (ECE)cited by 20
- 2025LoRA Training Provably Converges to a Low-Rank Global Minimum or It Fails Loudly (But it Probably Won't Fail)cited by 19
- 2020PATHoBot: A Robot for Glasshouse Crop Phenotyping and Interventioncited by 18
50 most cited of 63 All 63 (JSON)
Built on by
Not cited yet.