# Whale Detection Enhancement through Synthetic Satellite Images

arXiv: https://arxiv.org/abs/2308.07766 · HTML: https://mlsanity.com/paper/2308.07766/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 10 of its 45 references that are in the map.
- First posted on arXiv 15 Aug 2023.

## Builds on (most cited first, 10 of 10)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Feature Pyramid Networks for Object Detection](https://mlsanity.com/paper/1612.03144/) (2016)
- [Optimizing the Dice Score and Jaccard Index for Medical Image Segmentation: Theory & Practice](https://mlsanity.com/paper/1911.01685/) (2019)
- [SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Water](https://mlsanity.com/paper/2105.01922/) (2021)
- [RarePlanes: Synthetic Data Takes Flight](https://mlsanity.com/paper/2006.02963/) (2020)
- [Leveraging Synthetic Data in Object Detection on Unmanned Aerial Vehicles](https://mlsanity.com/paper/2112.12252/) (2021)
- [OysterNet: Enhanced Oyster Detection Using Simulation](https://mlsanity.com/paper/2209.08176/) (2022)
- [SARDO: An Automated Search-and-Rescue Drone-based Solution for Victims Localization](https://mlsanity.com/paper/2003.05819/) (2020)
- [OysterSim: Underwater Simulation for Enhancing Oyster Reef Monitoring](https://mlsanity.com/paper/2209.09395/) (2022)
- [SeaDroneSim: Simulation of Aerial Images for Detection of Objects Above Water](https://mlsanity.com/paper/2210.16107/) (2022)

## Built on by (most cited first, 4 of 4)

- [ODYSSEE: Oyster Detection Yielded by Sensor Systems on Edge Electronics](https://mlsanity.com/paper/2409.07003/) (2024)
- [MARVIS: Motion & Geometry Aware Real and Virtual Image Segmentation](https://mlsanity.com/paper/2403.09850/) (2024)
- [Beluga Whale Detection from Satellite Imagery with Point Labels](https://mlsanity.com/paper/2505.12066/) (2025)
- [Synthetic Data Augmentation for Enhanced Chicken Carcass Instance Segmentation](https://mlsanity.com/paper/2507.18558/) (2025)

## Abstract (arXiv)

With a number of marine populations in rapid decline, collecting and analyzing data about marine populations has become increasingly important to develop effective conservation policies for a wide range of marine animals, including whales. Modern computer vision algorithms allow us to detect whales in images in a wide range of domains, further speeding up and enhancing the monitoring process. However, these algorithms heavily rely on large training datasets, which are challenging and time-consuming to collect particularly in marine or aquatic environments. Recent advances in AI however have made it possible to synthetically create datasets for training machine learning algorithms, thus enabling new solutions that were not possible before. In this work, we present a solution - SeaDroneSim2 benchmark suite, which addresses this challenge by generating aerial, and satellite synthetic image datasets to improve the detection of whales and reduce the effort required for training data collection. We show that we can achieve a 15% performance boost on whale detection compared to using the real data alone for training, by augmenting a 10% real data. We open source both the code of the simulation platform SeaDroneSim2 and the dataset generated through it.
