Fusion Complexity Is Not Fusion Quality: Backbone, Cross View Fusion and Metadata as Separate Factors in Pasture Biomass Regression
Not on the map. Why?
Abstract (arXiv)
Estimating pasture biomass from field images can support grazing decisions without repeated destructive sampling. The task remains difficult because available datasets are small, biomass components are imbalanced and a single photograph contains two spatially distinct views of the sampled quadrat. This work evaluates vision foundation models for five target pasture biomass regression on the 357 image CSIRO dataset. Across 25 model configurations, the analysis covers convolutional and self supervised transformer backbones, seven cross view fusion configurations, models with and without 23 metadata features, classical regressors and frozen foundation features. All comparisons use one locked five fold split and raw scale weighted R^2. DINOv3 Large with cross view gated attention gives the strongest verified single model result, 0.8338 +/- 0.0503 across folds. Under a matched gated depthwise convolution head, replacing DINOv2 Large with DINOv3 Large improves R^2 by 0.0372. Fusion results are not ordered by module complexity. Cross view gated attention is best, while a full Mamba fusion block reaches only 0.7930. Across four matched DINOv3 pathways, metadata narrows the score range from 0.0157 to 0.0013 while changing the mean by only +0.0034. It improves three weaker pathways but lowers the strongest attention model by 0.0061. Classical metadata models are strong, frozen DINOv3 features are linearly useful and Dry Dead biomass remains the hardest target. These results show that backbone choice, cross view interaction and metadata must be tested as separate factors on small agricultural datasets.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 41 references that are in the map. First posted on arXiv 8 Mar 2026.
Builds on
22 of 41 references.
References · 22
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2025DINOv3cited by 1,414
10 more
- 2017Mixed Precision Trainingcited by 1,156
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2024VMamba: Visual State Space Modelcited by 969
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2016Language Modeling with Gated Convolutional Networkscited by 702
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
- 2023Multimodal Deep Learningcited by 258
- 2021Understanding Robustness of Transformers for Image Classificationcited by 249
- 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbonecited by 224
- 2025Estimating Pasture Biomass from Top-View Images: A Dataset for Precision Agriculturecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Multimodal Fusion Strategies for Mapping Biophysical Landscape Features
- 2025Can Large Multimodal Models Understand Agricultural Scenes? Benchmarking with AgroMind
- 2024AgriCLIP: Adapting CLIP for Agriculture and Livestock via Domain-Specialized Cross-Model Alignment
- 2024REO-VLM: Transforming VLM to Meet Regression Challenges in Earth Observation
- 2025Towards Unified Vision Language Models for Forest Ecological Analysis in Earth Observation
- 2022Transfer Learning with Pretrained Remote Sensing Transformers
- 2026CAFOSat: A Strongly Annotated Dataset for Infrastructure-Aware CAFO Mapping Using High-Resolution Imagery
- 2023Using Global Land Cover Product as Prompt for Cropland Mapping via Visual Foundation Model