HSDA: High-frequency Shuffle Data Augmentation for Bird's-Eye-View Map Segmentation
Not on the map. Why?
Abstract (arXiv)
Autonomous driving has garnered significant attention in recent research, and Bird's-Eye-View (BEV) map segmentation plays a vital role in the field, providing the basis for safe and reliable operation. While data augmentation is a commonly used technique for improving BEV map segmentation networks, existing approaches predominantly focus on manipulating spatial domain representations. In this work, we investigate the potential of frequency domain data augmentation for camera-based BEV map segmentation. We observe that high-frequency information in camera images is particularly crucial for accurate segmentation. Based on this insight, we propose High-frequency Shuffle Data Augmentation (HSDA), a novel data augmentation strategy that enhances a network's ability to interpret high-frequency image content. This approach encourages the network to distinguish relevant high-frequency information from noise, leading to improved segmentation results for small and intricate image regions, as well as sharper edge and detail perception. Evaluated on the nuScenes dataset, our method demonstrates broad applicability across various BEV map segmentation networks, achieving a new state-of-the-art mean Intersection over Union (mIoU) of 61.3% for camera-only systems. This significant improvement underscores the potential of frequency domain data augmentation for advancing the field of autonomous driving perception. Code has been released: https://github.com/Zarhult/HSDA
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 9 Dec 2024.
Builds on
36 of 45 references.
References · 36
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2015Cyclical Learning Rates for Training Neural Networkscited by 627
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 351
- 2019Class-balanced Grouping and Sampling for Point Cloud 3D Object Detectioncited by 350
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
24 more
- 2022BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Drivingcited by 191
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 2022M2BEV: Multi-Camera Joint 3D Detection and Segmentation with Unified Birds-Eye View Representationcited by 155
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 20183D-LaneNet: End-to-End 3D Multiple Lane Detectioncited by 106
- 2020MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Mapscited by 100
- 2023Bird's-Eye-View Scene Graph for Vision-Language Navigationcited by 71
- 2021Learning Auxiliary Monocular Contexts Helps Monocular 3D Object Detectioncited by 66
- 2021InverseForm: A Loss Function for Structured Boundary-Aware Segmentationcited by 65
- 2023TimesURL: Self-supervised Contrastive Learning for Universal Time Series Representation Learningcited by 51
- 2022Data Augmentation techniques in time series domain: A survey and taxonomycited by 41
- 2022X-Align: Cross-Modal Cross-View Alignment for Bird's-Eye-View Segmentationcited by 38
- 2021AuxAdapt: Stable and Efficient Test-Time Adaptation for Temporally Consistent Video Semantic Segmentationcited by 31
- 2022Learning Implicit Feature Alignment Function for Semantic Segmentationcited by 31
- 2023TBP-Former: Learning Temporal Bird's-Eye-View Pyramid for Joint Perception and Prediction in Vision-Centric Autonomous Drivingcited by 30
- 2020Driving among Flatmobiles: Bird-Eye-View occupancy grids from a monocular camera for holistic trajectory planningcited by 24
- 2021Monocular 3D Vehicle Detection Using Uncalibrated Traffic Cameras through Homographycited by 21
- 2020Real-Time High-Performance Semantic Image Segmentation of Urban Street Scenescited by 19
- 2021Pattern-Aware Data Augmentation for LiDAR 3D Object Detectioncited by 15
- 2021Perceptual Consistency in Video Segmentationcited by 12
- 2021HS3: Learning with Proper Task Complexity in Hierarchically Supervised Semantic Segmentationcited by 12
- 2022Panoptic, Instance and Semantic Relations: A Relational Context Encoder to Enhance Panoptic Segmentationcited by 9
- 2023Residual Graph Convolutional Network for Bird's-Eye-View Semantic Segmentationcited by 5
- 2024Dominant Shuffle: A Simple Yet Powerful Data Augmentation for Time-series Predictioncited by 2
Built on by
Not cited yet.