# A Parametric Top-View Representation of Complex Road Scenes

arXiv: https://arxiv.org/abs/1812.06152 · HTML: https://mlsanity.com/paper/1812.06152/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Dec 2018.

## Built on by (most cited first, 20 of 20)

- [Categorical Depth Distribution Network for Monocular 3D Object Detection](https://mlsanity.com/paper/2103.01100/) (2021)
- [Translating Images into Maps](https://mlsanity.com/paper/2110.00966/) (2021)
- [Vision-based Uneven BEV Representation Learning with Polar Rasterization and Surface Estimation](https://mlsanity.com/paper/2207.01878/) (2022)
- [HFT: Lifting Perspective Representations via Hybrid Feature Transformation](https://mlsanity.com/paper/2204.05068/) (2022)
- [DROID: Driver-centric Risk Object Identification](https://mlsanity.com/paper/2106.13201/) (2021)
- [Towards a Multi-Agent Vision-Language System for Zero-Shot Novel Hazardous Object Detection for Autonomous Driving Safety](https://mlsanity.com/paper/2504.13399/) (2025)
- [MVPbev: Multi-view Perspective Image Generation from BEV with Test-time Controllability and Generalizability](https://mlsanity.com/paper/2407.19468/) (2024)
- [CurveCloudNet: Processing Point Clouds with 1D Structure](https://mlsanity.com/paper/2303.12050/) (2023)
- ["The Pedestrian next to the Lamppost" Adaptive Object Graphs for Better Instantaneous Mapping](https://mlsanity.com/paper/2204.02944/) (2022)
- [Monocular BEV Perception of Road Scenes via Front-to-Top View Projection](https://mlsanity.com/paper/2211.08144/) (2022)
- [Learning Road Scene-level Representations via Semantic Region Prediction](https://mlsanity.com/paper/2301.00714/) (2023)
- [Weakly But Deeply Supervised Occlusion-Reasoned Parametric Road Layouts](https://mlsanity.com/paper/2104.06730/) (2021)
- [Learning a Model for Inferring a Spatial Road Lane Network Graph using Self-Supervision](https://mlsanity.com/paper/2107.01784/) (2021)
- [Monocular Multi-Layer Layout Estimation for Warehouse Racks](https://mlsanity.com/paper/2103.09174/) (2021)
- [SBEVNet: End-to-End Deep Stereo Layout Estimation](https://mlsanity.com/paper/2105.11705/) (2021)
- [AutoLay: Benchmarking amodal layout estimation for autonomous driving](https://mlsanity.com/paper/2108.09047/) (2021)
- [Self-Supervised Road Layout Parsing with Graph Auto-Encoding](https://mlsanity.com/paper/2203.11000/) (2022)
- [MVRackLay: Monocular Multi-View Layout Estimation for Warehouse Racks and Shelves](https://mlsanity.com/paper/2211.16882/) (2022)
- [From Bird's-Eye to Street View: Crafting Diverse and Condition-Aligned Images with Latent Diffusion Model](https://mlsanity.com/paper/2409.01014/) (2024)
- [SIM: A mapping framework for built environment auditing based on street view imagery](https://mlsanity.com/paper/2505.24076/) (2025)

## Abstract (arXiv)

In this paper, we address the problem of inferring the layout of complex road scenes given a single camera as input. To achieve that, we first propose a novel parameterized model of road layouts in a top-view representation, which is not only intuitive for human visualization but also provides an interpretable interface for higher-level decision making. Moreover, the design of our top-view scene model allows for efficient sampling and thus generation of large-scale simulated data, which we leverage to train a deep neural network to infer our scene model's parameters. Specifically, our proposed training procedure uses supervised domain-adaptation techniques to incorporate both simulated as well as manually annotated data. Finally, we design a Conditional Random Field (CRF) that enforces coherent predictions for a single frame and encourages temporal smoothness among video frames. Experiments on two public data sets show that: (1) Our parametric top-view model is representative enough to describe complex road scenes; (2) The proposed method outperforms baselines trained on manually-annotated or simulated data only, thus getting the best of both; (3) Our CRF is able to generate temporally smoothed while semantically meaningful results.