When Bigger is Worse: A Practitioner's Guide to Model Selection Under Data Scarcity
Not on the map. Why?
Abstract (arXiv)
Scaling laws assume larger models trained on more data consistently outperform smaller ones -- an assumption that drives model selection in computer vision but remains untested in resource-constrained Earth observation (EO). We conduct a systematic efficiency analysis across three scaling dimensions: model size, dataset size, and input resolution, on rooftop photovoltaic (PV) detection in Madagascar, yielding 180 training runs across 60 configurations. Optimizing for model efficiency (mAP50 per unit of model size), we find a consistent efficiency inversion: YOLO11N achieves the highest efficiency (22× higher than YOLO11X) with no accuracy penalty: it reaches the second highest absolute mAP50 (0.459), outperforming all models except YOLO11S by a margin smaller than run-to-run variance, directly contradicting the scaling prior. Resolution is the dominant resource allocation lever: moving from 416 px to 1280 px at 10 % of the data matches the efficiency gain of collecting the full dataset at low resolution. These findings are robust to the deployment objective: small high-resolution configurations are Pareto-dominant across all 60 experimental setups in the joint accuracy-throughput space, leaving no tradeoff to resolve. In data-scarce EO, the scaling prior does not just fail: it inverts.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
22 of 40 references.
References · 22
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2014How transferable are features in deep neural networks?cited by 1,216
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
- 2018xView: Objects in Context in Overhead Imagerycited by 145
10 more
- 2017An Analysis of Scale Invariance in Object Detection - SNIPcited by 119
- 2018Modeling Visual Context is Key to Augmenting Object Detection Datasetscited by 106
- 2022Better plain ViT baselines for ImageNet-1kcited by 97
- 2016A Survey on Object Detection in Optical Remote Sensing Imagescited by 78
- 2018The Effects of Super-Resolution on Object Detection Performance in Satellite Imagerycited by 57
- 2020A Close Look at Deep Learning with Small Datacited by 54
- 2019BAOD: Budget-Aware Object Detectioncited by 9
- 2022A crowdsourced dataset of aerial images with annotated solar photovoltaic arrays and installation metadatacited by 9
- 2022HyperionSolarNet: Solar Panel Detection from Aerial Imagescited by 8
- 2024Space-scale Exploration of the Poor Reliability of Deep Learning Models: the Case of the Remote Sensing of Rooftop Photovoltaic Systemscited by 4
Built on by
Not cited yet.