Noise-Aware Unsupervised Deep Lidar-Stereo Fusion
Not on the map. Why?
Abstract (arXiv)
In this paper, we present LidarStereoNet, the first unsupervised Lidar-stereo fusion network, which can be trained in an end-to-end manner without the need of ground truth depth maps. By introducing a novel "Feedback Loop'' to connect the network input with output, LidarStereoNet could tackle both noisy Lidar points and misalignment between sensors that have been ignored in existing Lidar-stereo fusion studies. Besides, we propose to incorporate a piecewise planar model into network learning to further constrain depths to conform to the underlying 3D geometry. Extensive quantitative and qualitative evaluations on both real and synthetic datasets demonstrate the superiority of our method, which outperforms state-of-the-art stereo matching, depth completion and Lidar-Stereo fusion approaches significantly.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 11; 2023: 4; 2024: 8; 2025: 3.
31 papers.
Sort:
By area:
- 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Surveycited by 76
- 2021Positive Sample Propagation along the Audio-Visual Event Linecited by 69
- 2022Implicit Motion Handling for Video Camouflaged Object Detectioncited by 60
- 2022Contrastive Positive Sample Propagation along the Audio-Visual Event Linecited by 50
- 2024Multimodal Fusion on Low-quality Data: A Comprehensive Surveycited by 49
- 2022HRFuser: A Multi-resolution Sensor Fusion Architecture for 2D Object Detectioncited by 31
- 2022Vicinity Vision Transformercited by 22
- 2023Revisiting Depth Completion from a Stereo Matching Perspective for Cross-domain Generalizationcited by 18
- 2024SAM-PM: Enhancing Video Camouflaged Object Detection using Spatio-Temporal Attentioncited by 11
- 2024Locality-aware Cross-modal Correspondence Learning for Dense Audio-Visual Events Localizationcited by 11
- 2021S3: Learnable Sparse Signal Superdensity for Guided Depth Estimationcited by 10
- 2022Unsupervised confidence for LiDAR depth maps and applicationscited by 10
19 more
- 2022Deep Laparoscopic Stereo Matching with Transformerscited by 9
- 2022Mind The Edge: Refining Depth Edges in Sparsely-Supervised Monocular Depth Estimationcited by 8
- 2023Active Stereo Without Pattern Projectorcited by 8
- 2021LiDARTouch: Monocular metric depth estimation with a few-beam LiDARcited by 7
- 2024LiDAR-Event Stereo Fusion with Hallucinationscited by 7
- 2022CU-Net: LiDAR Depth-Only Completion With Coupled U-Netcited by 6
- 2022Multi-View Guided Multi-View Stereocited by 5
- 2024Stereo-LiDAR Depth Estimation with Deformable Propagation and Learned Disparity-Depth Conversioncited by 4
- 2021Sparse LiDAR and Stereo Fusion (SLS-Fusion) for Depth Estimationand 3D Object Detectioncited by 3
- 2021Fast and Accurate: Video Enhancement using Sparse Depthcited by 2
- 2023Shape-Net: Room Layout Estimation from Panoramic Images Robust to Occlusion using Knowledge Distillation with 3D Shapes as Additional Inputscited by 2
- 2024Camouflaged Object Tracking: A Benchmarkcited by 2
- 2025Audio Does Matter: Importance-Aware Multi-Granularity Fusion for Video Moment Retrievalcited by 2
- 2022Non-learning Stereo-aided Depth Completion under Mis-projection via Selective Stereo Matchingcited by 1
- 2023A survey on deep learning approaches for data integration in autonomous driving systemcited by 1
- 2024Active Stereo in the Wild through Virtual Pattern Projectioncited by 0
- 2024Multi-QuAD: Multi-Level Quality-Adaptive Dynamic Network for Reliable Multimodal Classificationcited by 0
- 2025A Reinforcement Learning Method for Environments with Stochastic Variables: Post-Decision Proximal Policy Optimization with Dual Critic Networkscited by 0
- 2025Preserving Guidance in Cost-Volume Retrieval under Extreme LiDAR Sparsity in Iterative Stereocited by 0
- 2025Audio Does Matter: Importance-Aware Multi-Granularity Fusion for Video Moment Retrieval6 Aug 2025
- 2025Preserving Guidance in Cost-Volume Retrieval under Extreme LiDAR Sparsity in Iterative Stereo26 Jul 2025
- 2025A Reinforcement Learning Method for Environments with Stochastic Variables: Post-Decision Proximal Policy Optimization with Dual Critic Networks7 Apr 2025
- 2024Multi-QuAD: Multi-Level Quality-Adaptive Dynamic Network for Reliable Multimodal Classification19 Dec 2024
- 2024Locality-aware Cross-modal Correspondence Learning for Dense Audio-Visual Events Localization12 Sep 2024
- 2024Camouflaged Object Tracking: A Benchmark25 Aug 2024
- 2024LiDAR-Event Stereo Fusion with Hallucinations8 Aug 2024
- 2024SAM-PM: Enhancing Video Camouflaged Object Detection using Spatio-Temporal Attention9 Jun 2024
- 2024Active Stereo in the Wild through Virtual Pattern Projection6 Jun 2024
- 2024Multimodal Fusion on Low-quality Data: A Comprehensive Survey27 Apr 2024
- 2024Stereo-LiDAR Depth Estimation with Deformable Propagation and Learned Disparity-Depth Conversion11 Apr 2024
- 2023Revisiting Depth Completion from a Stereo Matching Perspective for Cross-domain Generalization14 Dec 2023
19 more
- 2023Active Stereo Without Pattern Projector21 Sep 2023
- 2023A survey on deep learning approaches for data integration in autonomous driving system17 Jun 2023
- 2023Shape-Net: Room Layout Estimation from Panoramic Images Robust to Occlusion using Knowledge Distillation with 3D Shapes as Additional Inputs25 Apr 2023
- 2022Mind The Edge: Refining Depth Edges in Sparsely-Supervised Monocular Depth Estimation10 Dec 2022
- 2022Contrastive Positive Sample Propagation along the Audio-Visual Event Line18 Nov 2022
- 2022CU-Net: LiDAR Depth-Only Completion With Coupled U-Net26 Oct 2022
- 2022Multi-View Guided Multi-View Stereo20 Oct 2022
- 2022Unsupervised confidence for LiDAR depth maps and applications6 Oct 2022
- 2022Non-learning Stereo-aided Depth Completion under Mis-projection via Selective Stereo Matching4 Oct 2022
- 2022Deep Laparoscopic Stereo Matching with Transformers25 Jul 2022
- 2022HRFuser: A Multi-resolution Sensor Fusion Architecture for 2D Object Detection30 Jun 2022
- 2022Vicinity Vision Transformer21 Jun 2022
- 2022Implicit Motion Handling for Video Camouflaged Object Detection14 Mar 2022
- 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Survey6 Feb 2022
- 2021LiDARTouch: Monocular metric depth estimation with a few-beam LiDAR8 Sep 2021
- 2021Positive Sample Propagation along the Audio-Visual Event Line1 Apr 2021
- 2021Fast and Accurate: Video Enhancement using Sparse Depth15 Mar 2021
- 2021Sparse LiDAR and Stereo Fusion (SLS-Fusion) for Depth Estimationand 3D Object Detection5 Mar 2021
- 2021S3: Learnable Sparse Signal Superdensity for Guided Depth Estimation3 Mar 2021
- 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Surveycited by 76
- 2021Positive Sample Propagation along the Audio-Visual Event Linecited by 69
- 2022Implicit Motion Handling for Video Camouflaged Object Detectioncited by 60
- 2022Contrastive Positive Sample Propagation along the Audio-Visual Event Linecited by 50
- 2024Multimodal Fusion on Low-quality Data: A Comprehensive Surveycited by 49
- 2022HRFuser: A Multi-resolution Sensor Fusion Architecture for 2D Object Detectioncited by 31
- 2022Vicinity Vision Transformercited by 22
- 2023Revisiting Depth Completion from a Stereo Matching Perspective for Cross-domain Generalizationcited by 18
- 2024SAM-PM: Enhancing Video Camouflaged Object Detection using Spatio-Temporal Attentioncited by 11
- 2024Locality-aware Cross-modal Correspondence Learning for Dense Audio-Visual Events Localizationcited by 11
- 2021S3: Learnable Sparse Signal Superdensity for Guided Depth Estimationcited by 10
- 2022Unsupervised confidence for LiDAR depth maps and applicationscited by 10
12 most cited of 30 All 30 (JSON)
- 2025Audio Does Matter: Importance-Aware Multi-Granularity Fusion for Video Moment Retrieval6 Aug 2025
- 2025Preserving Guidance in Cost-Volume Retrieval under Extreme LiDAR Sparsity in Iterative Stereo26 Jul 2025
- 2024Multi-QuAD: Multi-Level Quality-Adaptive Dynamic Network for Reliable Multimodal Classification19 Dec 2024
- 2024Locality-aware Cross-modal Correspondence Learning for Dense Audio-Visual Events Localization12 Sep 2024
- 2024Camouflaged Object Tracking: A Benchmark25 Aug 2024
- 2024LiDAR-Event Stereo Fusion with Hallucinations8 Aug 2024
- 2024SAM-PM: Enhancing Video Camouflaged Object Detection using Spatio-Temporal Attention9 Jun 2024
- 2024Active Stereo in the Wild through Virtual Pattern Projection6 Jun 2024
- 2024Multimodal Fusion on Low-quality Data: A Comprehensive Survey27 Apr 2024
- 2024Stereo-LiDAR Depth Estimation with Deformable Propagation and Learned Disparity-Depth Conversion11 Apr 2024
- 2023Revisiting Depth Completion from a Stereo Matching Perspective for Cross-domain Generalization14 Dec 2023
- 2023Active Stereo Without Pattern Projector21 Sep 2023
12 newest of 30 All 30 (JSON)