mlsanityData to 7 Oct 2026

ST-LoRA: Single Trajectory LoRA Ensemble for Uncertainty Aware Agricultural Segmentation

arXiv 2608.01530 ↗First posted 2 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reliable decision support in digital agriculture requires not only accurate predictions but also well-calibrated uncertainty estimates, particularly for dense prediction tasks such as semantic segmentation. Ensembles provide strong uncertainty quantification but are computationally and memory demanding, while single-model approximations often sacrifice uncertainty quality. We propose ST-LoRA, a parameter-efficient ensemble that builds diverse members from a single training trajectory by combining Low-Rank Adaptation (LoRA) with snapshot ensembling. All members share a frozen pretrained backbone and differ only in lightweight low-rank adapters, which sharply reduces trainable parameters, checkpoint storage, and I/O overhead. We evaluate SegFormer, Mask2Former, and EoMT on GrowliFlower-L (cauliflower, open field) and BUP20 (sweet pepper, glasshouse), covering in-distribution performance, calibration under covariate shift, and near- and far-out-of-distribution (OoD) detection, with BUTom21 (tomato) as near-OoD data. Extensive ablations show that feed-forward layers, not attention projections, are the critical LoRA target for dense prediction, and that the scaling ratio α/r governs an accuracy--calibration trade-off. Against full-rank snapshot ensembles, ST-LoRA is competitive in segmentation quality, with architecture-dependent training time and energy savings. Against MC Dropout, DDU, and six post-hoc calibrators, it achieves the strongest far-OoD image-level detection and near-OoD pixel-level localization with low cross-seed variance, although full-rank ensembles remain better calibrated. These results show that LoRA-based ensembling offers a compelling efficiency--performance trade-off for agricultural vision systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 63 of its 108 references that are in the map. First posted on arXiv 2 Aug 2026.

Builds on

63 of 108 references.

References · 63

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2017On Calibration of Modern Neural Networkscited by 4,860
  5. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  6. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  7. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  8. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  9. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  10. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  11. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
  12. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
38 more
  1. 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
  2. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
  3. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
  4. 2021Towards a Unified View of Parameter-Efficient Transfer Learningcited by 863
  5. 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 798
  6. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
  7. 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
  8. 2021Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depthcited by 411
  9. 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
  10. 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 368
  11. 2017Snapshot Ensembles: Train 1, get M for freecited by 349
  12. 2024LoRA Learns Less and Forgets Lesscited by 313
  13. 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
  14. 2020Training independent subnetworks for robust predictioncited by 177
  15. 2021A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challengescited by 154
  16. 2021MoEfication: Transformer Feed-forward Layers are Mixtures of Expertscited by 149
  17. 2014A Tutorial on Principal Component Analysiscited by 139
  18. 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
  19. 2018Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batchescited by 133
  20. 2022Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning: Are Conditional Entropy and Mutual Information Appropriate Measures?cited by 124
  21. 2020Local Temperature Scaling for Probability Calibrationcited by 95
  22. 2021Spectral Normalisation for Deep Reinforcement Learning: an Optimisation Perspectivecited by 64
  23. 2021Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Boundscited by 64
  24. 2021On the Practicality of Deterministic Epistemic Uncertaintycited by 62
  25. 2021Do You Even Need Attention? A Stack of Feed-Forward Layers Does Surprisingly Well on ImageNetcited by 61
  26. 2025Energy Considerations of Large Language Model Inference and Efficiency Optimizationscited by 54
  27. 2024Uncertainty quantification in fine-tuned LLMs using LoRA ensemblescited by 35
  28. 2021Meta-Cal: Well-controlled Post-hoc Calibration by Rankingcited by 33
  29. 2017Learning Algorithms for Active Learningcited by 30
  30. 2022When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanismcited by 30
  31. 2020Evaluating probabilistic classifiers: Reliability diagrams and score decompositions revisitedcited by 25
  32. 2022On Calibrating Semantic Segmentation Models: Analyses and An Algorithmcited by 25
  33. 2023Skip-Attention: Improving Vision Transformers by Paying Less Attentioncited by 23
  34. 2024Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Modelscited by 20
  35. 2024LoRA-Ensemble: Efficient Uncertainty Modelling for Self-Attention Networkscited by 20
  36. 2025Understanding Model Calibration -- A gentle introduction and visual exploration of calibration and the expected calibration error (ECE)cited by 20
  37. 2025LoRA Training Provably Converges to a Low-Rank Global Minimum or It Fails Loudly (But it Probably Won't Fail)cited by 19
  38. 2020PATHoBot: A Robot for Glasshouse Crop Phenotyping and Interventioncited by 18

50 most cited of 63 All 63 (JSON)

Built on by

Not cited yet.