TartanAir: A Dataset to Push the Limits of Visual SLAM
Not on the map. Why?
Cited by 29 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We present a challenging dataset, the TartanAir, for robot navigation tasks and more. The data is collected in photo-realistic simulation environments with the presence of moving objects, changing light and various weather conditions. By collecting data in simulations, we are able to obtain multi-modal sensor data and precise ground truth labels such as the stereo RGB image, depth image, segmentation, optical flow, camera poses, and LiDAR point cloud. We set up large numbers of environments with various styles and scenes, covering challenging viewpoints and diverse motion patterns that are difficult to achieve by using physical data collection platforms. In order to enable data collection at such a large scale, we develop an automatic pipeline, including mapping, trajectory sampling, data processing, and data verification. We evaluate the impact of various factors on visual SLAM algorithms using our data. The results of state-of-the-art algorithms reveal that the visual SLAM problem is far from solved. Methods that show good performance on established datasets such as KITTI do not perform well in more difficult scenarios. Although we use the simulation, our goal is to push the limits of Visual SLAM algorithms in the real world by providing a challenging benchmark for testing new methods, while also using a large diverse training data for learning-based methods. Our dataset is available at urlhttp://theairlab.org/tartanair-dataset.
Key facts. Cited by 494 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 40; 2023: 48; 2024: 72; 2025: 142; 2026: 173.
494 papers.
Sort:
By area:
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
38 more
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
- 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
- 2022Deep Patch Visual Odometrycited by 186
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 173
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
- 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 146
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
- 2023Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Camerascited by 139
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 130
- 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 122
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 100
- 2024Learning Temporally Consistent Video Depth from Video Diffusion Priorscited by 100
- 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 98
- 2022ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wildcited by 90
- 2025Easi3R: Estimating Disentangled Motion from DUSt3R Without Trainingcited by 88
- 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 85
- 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 84
- 2024Align3R: Aligned Monocular Depth Estimation for Dynamic Videoscited by 79
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 76
- 2022Perspective Fields for Single Image Camera Calibrationcited by 75
- 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 75
- 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Surveycited by 73
- 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 73
50 most cited of 494 All 494 (JSON)
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026Emergent Multi-View Geometry Through Self-Distillation30 Sep 2026
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space28 Sep 2026
- 2026DAPEVO: Deep Adaptive Patch Frame-Event Visual Odometry25 Sep 2026
- 2026GTR: Gated Token Recurrence for Efficient Dense Prediction22 Sep 2026
- 2026Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation21 Sep 2026
- 2026AnalogDepth: Multi-view Geometry from FPV drones under Analog Video Transmission21 Sep 2026
- 2026VGGT-Prime: Compute-Adaptive Mixture-of-Heads for Efficient Visual Geometry Transformers20 Sep 2026
- 2026Geometry beneath the Waves: Dense Priors for Sparse-View Underwater 3D Gaussian Splatting16 Sep 2026
- 2026SURE-Map: Self-Correcting Streaming Geometric Foundation Models14 Sep 2026
- 2026G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneity14 Sep 2026
- 2026FreeFlow: A Bias-free Hierarchical Transformer for Optical Flow Estimation10 Sep 2026
38 more
- 2026RoMa-Omega: What Feed-Forward 3D Models Know About Image Matching8 Sep 2026
- 2026OmniPoint: Universal Monocular Metric Pointcloud from Any Camera8 Sep 2026
- 2026NSFlow: End-to-End Differentiable Neuro-Symbolic Optical Flow for Visual Odometry5 Sep 2026
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States3 Sep 2026
- 2026VI3: Grounding Pretrained 3D Foundation Models with Inertial Cues3 Sep 2026
- 2026TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views1 Sep 2026
- 2026Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparison1 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026Failure or Drift? Evaluating Monocular SLAM under Synthetic and Real-World Corruptions31 Aug 2026
- 2026Efficient and High-Quality Depth Estimation via Pixel-Space Diffusion with Linear Attention31 Aug 2026
- 2026OptiGeo: Efficient Monocular Geometry for Embodied Perception in Optically Challenging Scenes30 Aug 2026
- 2026NBS: No Bias Stereo28 Aug 2026
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction27 Aug 2026
- 2026KLTNet: Learning Sparse Feature Tracking for Robust and Accurate Monocular Visual-Inertial Odometry25 Aug 2026
- 2026AquaFlow: A Monocular Gaussian Splatting SLAM for Underwater Streaming Reconstruction24 Aug 2026
- 2026ORBIT++: Benchmarking SfM in the Wild with 360deg Video22 Aug 2026
- 2026PXDepth: Pixel-Space Modeling for Structure Preserving Monocular Depth Estimation17 Aug 2026
- 2026WorldRover: A Scalable Synthetic Video Data Engine for World Exploration with Rich Annotations16 Aug 2026
- 2026Sekai2: From World Exploration to Interactive World Modeling10 Aug 2026
- 2026What Irregularity Costs: CUDA C++, Rust, and Triton on a Hash-Blocked GPU Workload8 Aug 2026
- 2026Dense Metric Depth Completion from Sparse Direct Time-of-Flight Sensors5 Aug 2026
- 2026Look Up and Look Back: Hidden Attention and Latent Orientation in a Frozen Foundation Model for Panoramic SLAM2 Aug 2026
- 2026Breaking the Horizontal Prior: From Long-Tailed Orientation Bias to Roll-Robust Monocular Depth Estimation1 Aug 2026
- 2026A Review Of Robotic World Models For Dynamic Environments Based On Factor And Scene Graphs27 Jul 2026
- 2026Unified Video Dense Prediction from Disjoint Data23 Jul 2026
- 2026WAT3R: Feedforward Underwater 3D Reconstruction23 Jul 2026
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching22 Jul 2026
- 2026MoGe-3: Fine-Detail Monocular Geometry Estimation with Self-Guided Sparse Volumetric Refinement20 Jul 2026
- 2026ALLUDE: A Unified Evaluation System for Configurable Attacks in Differentiable Environments19 Jul 2026
- 2026WAVE-Stereo: Warp-Aligned Volume Encoding for Stereo Matching15 Jul 2026
- 2026ARDepth: Auto-regressive Monocular Depth Estimation with Progressive Visual Conditioning14 Jul 2026
- 2026FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry13 Jul 2026
- 2026On the Real-World Generalisability of Optical Flow Models11 Jul 2026
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Models10 Jul 2026
- 2026Video Generation Models are General-Purpose Vision Learners10 Jul 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
50 newest of 494 All 494 (JSON)
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
- 2024Learning Temporally Consistent Video Depth from Video Diffusion Priorscited by 100
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 66
- 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformerscited by 47
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 36
- 2024Prometheus: 3D-Aware Latent Diffusion Models for Feed-Forward Text-to-3D Scene Generationcited by 33
- 2023Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Modelcited by 29
- 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstructioncited by 24
- 2025Lotus-2: Advancing Geometric Dense Prediction with Powerful Image Generative Modelcited by 16
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 15
- 2023PODIA-3D: Domain Adaptation of 3D Generative Model Across Large Domain Gap Using Pose-Preserved Text-to-Image Diffusioncited by 12
- 2026Repurposing Geometric Foundation Models for Multi-view Diffusioncited by 12
12 most cited of 28 All 28 (JSON)
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching22 Jul 2026
- 2026ARDepth: Auto-regressive Monocular Depth Estimation with Progressive Visual Conditioning14 Jul 2026
- 2026PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation2 Jul 2026
- 2026ICDepth: Taming Video Diffusion Models for Video Depth Estimation via In-Context Conditioning2 Jul 2026
- 2026TrackCraft3R: Repurposing Video Diffusion Transformers for Dense 3D Tracking12 May 2026
- 2026PoseFM: Relative Camera Pose Estimation Through Flow Matching24 Apr 2026
- 2026Any 3D Scene is Worth 1K Tokens: 3D-Grounded Representation for Scene Generation at Scale13 Apr 2026
- 2026DA-Flow: Degradation-Aware Optical Flow Estimation with Diffusion Models24 Mar 2026
- 2026Repurposing Geometric Foundation Models for Multi-view Diffusion23 Mar 2026
- 2026Leveling3D: Leveling Up 3D Reconstruction with Feed-Forward 3D Gaussian Splatting and Geometry-Aware Generation17 Mar 2026
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories2 Mar 2026
- 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstruction7 Jan 2026
12 newest of 28 All 28 (JSON)
- 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 59
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 39
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 34
- 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 33
- 2025SuperPC: A Single Diffusion Model for Point Cloud Completion, Upsampling, Denoising, and Colorizationcited by 20
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Frameworkcited by 14
- 2026VGGT-World: Transforming VGGT into an Autoregressive Geometry World Modelcited by 11
- 2026Planning in 8 Tokens: A Compact Discrete Tokenizer for Latent World Modelcited by 6
- 2026Stereo World Model: Camera-Guided Stereo Video Generationcited by 2
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Modelscited by 2
- 2026Sekai2: From World Exploration to Interactive World Modelingcited by 2
- 2026ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generationcited by 0
- 2026Sekai2: From World Exploration to Interactive World Modeling10 Aug 2026
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Models10 Jul 2026
- 2026ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generation8 May 2026
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework5 May 2026
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds15 Apr 2026
- 2026Stereo World Model: Camera-Guided Stereo Video Generation18 Mar 2026
- 2026VGGT-World: Transforming VGGT into an Autoregressive Geometry World Model13 Mar 2026
- 2026Planning in 8 Tokens: A Compact Discrete Tokenizer for Latent World Model5 Mar 2026
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videos1 Jan 2026
- 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Prediction25 Sep 2025
- 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modeling15 Sep 2025
- 2025SuperPC: A Single Diffusion Model for Point Cloud Completion, Upsampling, Denoising, and Colorization18 Mar 2025
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
12 most cited of 447 All 447 (JSON)
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026Emergent Multi-View Geometry Through Self-Distillation30 Sep 2026
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space28 Sep 2026
- 2026DAPEVO: Deep Adaptive Patch Frame-Event Visual Odometry25 Sep 2026
- 2026GTR: Gated Token Recurrence for Efficient Dense Prediction22 Sep 2026
- 2026Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation21 Sep 2026
- 2026AnalogDepth: Multi-view Geometry from FPV drones under Analog Video Transmission21 Sep 2026
- 2026VGGT-Prime: Compute-Adaptive Mixture-of-Heads for Efficient Visual Geometry Transformers20 Sep 2026
- 2026Geometry beneath the Waves: Dense Priors for Sparse-View Underwater 3D Gaussian Splatting16 Sep 2026
- 2026SURE-Map: Self-Correcting Streaming Geometric Foundation Models14 Sep 2026
- 2026G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneity14 Sep 2026
- 2026FreeFlow: A Bias-free Hierarchical Transformer for Optical Flow Estimation10 Sep 2026
12 newest of 447 All 447 (JSON)