# Combining crowd-sourcing and deep learning to explore the meso-scale organization of shallow convection

arXiv: https://arxiv.org/abs/1906.01906 · HTML: https://mlsanity.com/paper/1906.01906/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Jun 2019.

## Built on by (most cited first, 7 of 7)

- [Climate-Invariant Machine Learning](https://mlsanity.com/paper/2112.08440/) (2021)
- [SubseasonalClimateUSA: A Dataset for Subseasonal Forecasting and Benchmarking](https://mlsanity.com/paper/2109.10399/) (2021)
- [A Primer on Topological Data Analysis to Support Image Analysis Tasks in Environmental Science](https://mlsanity.com/paper/2207.10552/) (2022)
- [ClimateBench-M: A Multi-Modal Climate Data Benchmark with a Simple Generative Method](https://mlsanity.com/paper/2504.07394/) (2025)
- [Data-driven Cloud Clustering via a Rotationally Invariant Autoencoder](https://mlsanity.com/paper/2103.04885/) (2021)
- [Generative convective parametrization of dry atmospheric boundary layer](https://mlsanity.com/paper/2307.14857/) (2023)
- [Learning on Persistence Diagrams as Radon Measures](https://mlsanity.com/paper/2212.08295/) (2022)

## Abstract (arXiv)

Humans excel at detecting interesting patterns in images, for example those taken from satellites. This kind of anecdotal evidence can lead to the discovery of new phenomena. However, it is often difficult to gather enough data of subjective features for significant analysis. This paper presents an example of how two tools that have recently become accessible to a wide range of researchers, crowd-sourcing and deep learning, can be combined to explore satellite imagery at scale. In particular, the focus is on the organization of shallow cumulus convection in the trade wind regions. Shallow clouds play a large role in the Earth's radiation balance yet are poorly represented in climate models. For this project four subjective patterns of organization were defined: Sugar, Flower, Fish and Gravel. On cloud labeling days at two institutes, 67 scientists screened 10,000 satellite images on a crowd-sourcing platform and classified almost 50,000 mesoscale cloud clusters. This dataset is then used as a training dataset for deep learning algorithms that make it possible to automate the pattern detection and create global climatologies of the four patterns. Analysis of the geographical distribution and large-scale environmental conditions indicates that the four patterns have some overlap with established modes of organization, such as open and closed cellular convection, but also differ in important ways. The results and dataset from this project suggests promising research questions. Further, this study illustrates that crowd-sourcing and deep learning complement each other well for the exploration of image datasets.