AutoLay: Benchmarking amodal layout estimation for autonomous driving
Not on the map. Why?
Abstract (arXiv)
Given an image or a video captured from a monocular camera, amodal layout estimation is the task of predicting semantics and occupancy in bird's eye view. The term amodal implies we also reason about entities in the scene that are occluded or truncated in image space. While several recent efforts have tackled this problem, there is a lack of standardization in task specification, datasets, and evaluation protocols. We address these gaps with AutoLay, a dataset and benchmark for amodal layout estimation from monocular images. AutoLay encompasses driving imagery from two popular datasets: KITTI and Argoverse. In addition to fine-grained attributes such as lanes, sidewalks, and vehicles, we also provide semantically annotated 3D point clouds. We implement several baselines and bleeding edge approaches, and release our data and code.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 29 references that are in the map. First posted on arXiv 20 Aug 2021.
Builds on
21 of 29 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 455
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2017Joint 3D Proposal Generation and Object Detection from View Aggregationcited by 325
- 2016ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentationcited by 291
- 2020Deep Continuous Fusion for Multi-Sensor 3D Object Detectioncited by 263
- 2018Orthographic Feature Transform for Monocular 3D Object Detectioncited by 201
- 2018The ApolloScape Open Dataset for Autonomous Driving and its Applicationcited by 188
9 more
- 2019Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous Drivingcited by 188
- 2017A Survey of Structure from Motioncited by 157
- 20183D-LaneNet: End-to-End 3D Multiple Lane Detectioncited by 106
- 2018Monocular Semantic Occupancy Grid Mapping with Convolutional Variational Encoder-Decoder Networkscited by 84
- 2017Factoring Shape, Pose, and Layout from the 2D Image of a 3D Scenecited by 50
- 2018Learning to Look around Objects for Top-View Representations of Outdoor Scenescited by 37
- 2015Amodal Completion and Size Constancy in Natural Scenescited by 21
- 2018A Parametric Top-View Representation of Complex Road Scenescited by 20
- 2019Hallucinating Beyond Observation: Learning to Complete with Partial Observation and Unpaired Prior Knowledgecited by 2
Built on by
Citing papers per year: 2023: 1.
1 paper.