# A Geometric Approach to Obtain a Bird's Eye View from an Image

arXiv: https://arxiv.org/abs/1905.02231 · HTML: https://mlsanity.com/paper/1905.02231/

## Key facts

- Cited by 34 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 6 May 2019.

## Built on by (most cited first, 30 of 34)

- [Cross-view Transformers for real-time Map-view Semantic Segmentation](https://mlsanity.com/paper/2205.02833/) (2022)
- [CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformers](https://mlsanity.com/paper/2207.02202/) (2022)
- [NEAT: Neural Attention Fields for End-to-End Autonomous Driving](https://mlsanity.com/paper/2109.04456/) (2021)
- [Vision-Centric BEV Perception: A Survey](https://mlsanity.com/paper/2208.02797/) (2022)
- [Uncertainty-aware Vision-based Metric Cross-view Geolocalization](https://mlsanity.com/paper/2211.12145/) (2022)
- [Bird's-Eye-View Panoptic Segmentation Using Monocular Frontal View Images](https://mlsanity.com/paper/2108.03227/) (2021)
- [SuperFusion: Multilevel LiDAR-Camera Fusion for Long-Range HD Map Generation](https://mlsanity.com/paper/2211.15656/) (2022)
- [X-Align: Cross-Modal Cross-View Alignment for Bird's-Eye-View Segmentation](https://mlsanity.com/paper/2210.06778/) (2022)
- [SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understanding](https://mlsanity.com/paper/2306.05407/) (2023)
- [Vision-based Uneven BEV Representation Learning with Polar Rasterization and Surface Estimation](https://mlsanity.com/paper/2207.01878/) (2022)
- [Learning by Watching](https://mlsanity.com/paper/2106.05966/) (2021)
- [Deep Learning for Camera Calibration and Beyond: A Survey](https://mlsanity.com/paper/2303.10559/) (2023)
- [RoRD: Rotation-Robust Descriptors and Orthographic Views for Local Feature Matching](https://mlsanity.com/paper/2103.08573/) (2021)
- [Bi-Mapper: Holistic BEV Semantic Mapping for Autonomous Driving](https://mlsanity.com/paper/2305.04205/) (2023)
- [NeMO: Neural Map Growing System for Spatiotemporal Fusion in Bird's-Eye-View and BDD-Map Benchmark](https://mlsanity.com/paper/2306.04540/) (2023)
- [DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Construction](https://mlsanity.com/paper/2405.05518/) (2024)
- [A Cross-Scale Hierarchical Transformer with Correspondence-Augmented Attention for inferring Bird's-Eye-View Semantic Segmentation](https://mlsanity.com/paper/2304.03650/) (2023)
- [DuMapNet: An End-to-End Vectorization System for City-Scale Lane-Level Map Generation](https://mlsanity.com/paper/2406.14255/) (2024)
- [Voxelized 3D Feature Aggregation for Multiview Detection](https://mlsanity.com/paper/2112.03471/) (2021)
- [Residual Graph Convolutional Network for Bird's-Eye-View Semantic Segmentation](https://mlsanity.com/paper/2312.04044/) (2023)
- [Monocular BEV Perception of Road Scenes via Front-to-Top View Projection](https://mlsanity.com/paper/2211.08144/) (2022)
- [Aerial Diffusion: Text Guided Ground-to-Aerial View Translation from a Single Image using Diffusion Models](https://mlsanity.com/paper/2303.11444/) (2023)
- [GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction](https://mlsanity.com/paper/2409.08688/) (2024)
- [One Training for Multiple Deployments: Polar-based Adaptive BEV Perception for Autonomous Driving](https://mlsanity.com/paper/2304.00525/) (2023)
- [Automatic Vision-Based Parking Slot Detection and Occupancy Classification](https://mlsanity.com/paper/2308.08192/) (2023)
- [End-to-End Monocular Vanishing Point Detection Exploiting Lane Annotations](https://mlsanity.com/paper/2108.13699/) (2021)
- [Trans4Map: Revisiting Holistic Bird's-Eye-View Mapping from Egocentric Images to Allocentric Semantics with Vision Transformers](https://mlsanity.com/paper/2207.06205/) (2022)
- [Parameters, Properties, and Process: Conditional Neural Generation of Realistic SEM Imagery Towards ML-assisted Advanced Manufacturing](https://mlsanity.com/paper/2302.08495/) (2023)
- [HawkI: Homography & Mutual Information Guidance for 3D-free Single Image to Aerial View](https://mlsanity.com/paper/2311.15478/) (2023)
- [TopView: Vectorising road users in a bird's eye view from uncalibrated street-level imagery with deep learning](https://mlsanity.com/paper/2412.16229/) (2024)

## Abstract (arXiv)

The objective of this paper is to rectify any monocular image by computing a homography matrix that transforms it to a bird's eye (overhead) view. We make the following contributions: (i) we show that the homography matrix can be parameterised with only four parameters that specify the horizon line and the vertical vanishing point, or only two if the field of view or focal length is known; (ii) We introduce a novel representation for the geometry of a line or point (which can be at infinity) that is suitable for regression with a convolutional neural network (CNN); (iii) We introduce a large synthetic image dataset with ground truth for the orthogonal vanishing points, that can be used for training a CNN to predict these geometric entities; and finally (iv) We achieve state-of-the-art results on horizon detection, with 74.52% AUC on the Horizon Lines in the Wild dataset. Our method is fast and robust, and can be used to remove perspective distortion from videos in real time.
