# TartanAviation: Image, Speech, and ADS-B Trajectory Datasets for Terminal Airspace Operations

arXiv: https://arxiv.org/abs/2403.03372 · HTML: https://mlsanity.com/paper/2403.03372/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- Builds on 5 of its 23 references that are in the map.
- First posted on arXiv 5 Mar 2024.

## Builds on (most cited first, 5 of 5)

- [ATCO2 corpus: A Large-Scale Dataset for Research on Automatic Speech Recognition and Natural Language Understanding of Air Traffic Control Communications](https://mlsanity.com/paper/2211.04054/) (2022)
- [AirTrack: Onboard Deep Learning Framework for Long-Range Aircraft Detection and Tracking](https://mlsanity.com/paper/2209.12849/) (2022)
- [Predicting Like A Pilot: Dataset and Method to Predict Socially-Aware Aircraft Trajectories in Non-Towered Terminal Airspace](https://mlsanity.com/paper/2109.15158/) (2021)
- [AVOIDDS: Aircraft Vision-based Intruder Detection Dataset and Simulator](https://mlsanity.com/paper/2306.11203/) (2023)
- [A Dataset of Stationary, Fixed-wing Aircraft on a Collision Course for Vision-Based Sense and Avoid](https://mlsanity.com/paper/2112.02735/) (2021)

## Built on by (most cited first, 7 of 7)

- [PilotBench: A Benchmark for General Aviation Agents with Safety Constraints](https://mlsanity.com/paper/2604.08987/) (2026)
- [Demonstrating ViSafe: Vision-enabled Safety for High-speed Detect and Avoid](https://mlsanity.com/paper/2505.03694/) (2025)
- [AutoODD: Agentic Audits via Bayesian Red Teaming in Black-Box Models](https://mlsanity.com/paper/2509.08638/) (2025)
- [AIRHILT: A Human-in-the-Loop Testbed for Multimodal Conflict Detection in Aviation](https://mlsanity.com/paper/2511.18718/) (2025)
- [Unlocking air traffic flow prediction through microscopic aircraft-state modeling](https://mlsanity.com/paper/2605.10083/) (2026)
- [Formal, Executable and Explainable Runtime Monitoring of Spoken Air Traffic Control Operational Procedures](https://mlsanity.com/paper/2608.25926/) (2026)
- [FLY-EVAL++: An Evidence-Driven Evaluation Protocol for Safety-Constrained Flight Prediction with Large Language Models](https://mlsanity.com/paper/2609.04021/) (2026)

## Abstract (arXiv)

We introduce TartanAviation, an open-source multi-modal dataset focused on terminal-area airspace operations. TartanAviation provides a holistic view of the airport environment by concurrently collecting image, speech, and ADS-B trajectory data using setups installed inside airport boundaries. The datasets were collected at both towered and non-towered airfields across multiple months to capture diversity in aircraft operations, seasons, aircraft types, and weather conditions. In total, TartanAviation provides 3.1M images, 3374 hours of Air Traffic Control speech data, and 661 days of ADS-B trajectory data. The data was filtered, processed, and validated to create a curated dataset. In addition to the dataset, we also open-source the code-base used to collect and pre-process the dataset, further enhancing accessibility and usability. We believe this dataset has many potential use cases and would be particularly vital in allowing AI and machine learning technologies to be integrated into air traffic control systems and advance the adoption of autonomous aircraft in the airspace.