Occlusions, Motion and Depth Boundaries with a Generic Network for Disparity, Optical Flow or Scene Flow Estimation
Not on the map. Why?
Abstract (arXiv)
Occlusions play an important role in disparity and optical flow estimation, since matching costs are not available in occluded areas and occlusions indicate depth or motion boundaries. Moreover, occlusions are relevant for motion segmentation and scene flow estimation. In this paper, we present an efficient learning-based approach to estimate occlusion areas jointly with disparities or optical flow. The estimated occlusions and motion boundaries clearly improve over the state-of-the-art. Moreover, we present networks with state-of-the-art performance on the popular KITTI benchmark and good generic performance. Making use of the estimated occlusions, we also show improved results on motion segmentation and scene flow estimation.
Key facts. Cited by 69 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 17; 2023: 9; 2024: 8; 2025: 4; 2026: 7.
69 papers.
Sort:
By area:
- 2021SMD-Nets: Stereo Mixture Density Networkscited by 118
- 2021MobileStereoNet: Towards Lightweight Deep Networks for Stereo Matchingcited by 82
- 2023MFT: Long-Term Tracking of Every Pixelcited by 61
- 2022Learning Dense and Continuous Optical Flow from an Event Cameracited by 59
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2022Learning Pixel Trajectories with Multiscale Contrastive Random Walkscited by 36
- 2023Hidden Gems: 4D Radar Scene Flow Learning Using Cross-Modal Supervisioncited by 36
- 2022Learning Optical Flow, Depth, and Scene Flow without Real-World Labelscited by 31
- 2022What Matters for 3D Scene Flow Networkcited by 31
- 2021FESTA: Flow Estimation via Spatial-Temporal Attention for Scene Point Cloudscited by 30
- 2023Fully neuromorphic vision and control for autonomous drone flightcited by 30
- 2021Self-Supervised Multi-Frame Monocular Scene Flowcited by 29
38 more
- 2021Fast Training of Neural Lumigraph Representations using Meta Learningcited by 29
- 2023OpenStereo: A Comprehensive Benchmark for Stereo Matching and Strong Baselinecited by 28
- 2023RPEFlow: Multimodal Fusion of RGB-PointCloud-Event for Joint Optical Flow and Scene Flow Estimationcited by 26
- 2021SCTN: Sparse Convolution-Transformer Network for Scene Flow Estimationcited by 23
- 2024A Survey on Deep Stereo Matching in the Twentiescited by 23
- 2021Binary TTC: A Temporal Geofence for Autonomous Navigationcited by 20
- 2021Neural Disparity Refinement for Arbitrary Resolution Stereocited by 20
- 2025Zero-Shot Monocular Scene Flow Estimation in the Wildcited by 20
- 2021VOLDOR: Visual Odometry from Log-logistic Dense Optical flow Residualscited by 17
- 2021Residual 3D Scene Flow Learning with Context-Aware Feature Extractioncited by 15
- 2023CCMR: High Resolution Optical Flow Estimation via Coarse-to-Fine Context-Guided Motion Reasoningcited by 15
- 2022ChiTransformer:Towards Reliable Stereo from Cuescited by 14
- 2022Optical Flow Training under Limited Label Budget via Active Learningcited by 14
- 2022Self-supervised Amodal Video Object Segmentationcited by 14
- 2022RMS-FlowNet: Efficient and Robust Multi-Scale Scene Flow Estimation for Large-Scale Point Cloudscited by 13
- 2021Occlusion Guided Self-supervised Scene Flow Estimation on 3D Point Cloudscited by 11
- 2021FADNet++: Real-Time and Accurate Disparity Estimation with Configurable Networkscited by 11
- 2022NanoFlowNet: Real-time Dense Optical Flow on a Nano Quadcoptercited by 10
- 2026Attend Before Attention: Efficient and Scalable Video Understanding via Autoregressive Gazingcited by 8
- 2022Unsupervised Learning of 3D Scene Flow from Monocular Cameracited by 7
- 20223D Scene Flow Estimation on Pseudo-LiDAR: Bridging the Gap on Estimating Point Motioncited by 7
- 2025What Makes Good Synthetic Training Data for Zero-Shot Stereo Matching?cited by 7
- 2022RGB-Multispectral Matching: Dataset, Learning Methodology, Evaluationcited by 6
- 2022DirectTracker: 3D Multi-Object Tracking Using Direct Image Alignment and Photometric Bundle Adjustmentcited by 6
- 2021ORStereo: Occlusion-Aware Recurrent Stereo Matching for 4K-Resolution Imagescited by 5
- 2023Learning to Estimate Single-View Volumetric Flow Motions without 3D Supervisioncited by 5
- 2023The Drunkard's Odometry: Estimating Camera Motion in Deforming Scenescited by 5
- 2024SDGE: Stereo Guided Depth Estimation for 360^circ Camera Setscited by 5
- 2021Blocks World Revisited: The Effect of Self-Occlusion on Classification by Convolutional Neural Networkscited by 4
- 2021Detail Preserving Residual Feature Pyramid Modules for Optical Flowcited by 4
- 2021Sensor-Guided Optical Flowcited by 4
- 2021Joint Detection of Motion Boundaries and Occlusionscited by 4
- 2021DCVNet: Dilated Cost Volume Networks for Fast Optical Flowcited by 3
- 2021Self-Supervised Approach for Facial Movement Based Optical Flowcited by 3
- 2022Learning Scene Flow in 3D Point Clouds with Noisy Pseudo Labelscited by 3
- 2022Unsupervised Flow Refinement near Motion Boundariescited by 3
- 2022GMA3D: Local-Global Attention Learning to Estimate Occluded Motions of Scene Flowcited by 3
- 2021L3C-Stereo: Lossless Compression for Stereo Imagescited by 2
50 most cited of 69 All 69 (JSON)
- 2026STEMPix: A Phase-Transition-Material-Based Pixel Sensor for Resolving Edge-Movement Direction3 Sep 2026
- 2026MinNav: Minimalist Navigation Using Optical Flow For Active Tiny Aerial Robots5 Jun 2026
- 2026Flow of Truth: Proactive Temporal Forensics for Image-to-Video Generation16 Apr 2026
- 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matching10 Apr 2026
- 2026Attend Before Attention: Efficient and Scalable Video Understanding via Autoregressive Gazing12 Mar 2026
- 2026SF3D-RGB: Scene Flow Estimation from Monocular Camera and Sparse LiDAR25 Feb 2026
- 2026SRFlow: A Dataset and Regularization Model for High-Resolution Facial Optical Flow via Splatting Rasterization10 Jan 2026
- 2025What Makes Good Synthetic Training Data for Zero-Shot Stereo Matching?23 Apr 2025
- 2025ProbDiffFlow: An Efficient Learning-Free Framework for Probabilistic Single-Image Optical Flow Estimation16 Mar 2025
- 2025Zero-Shot Monocular Scene Flow Estimation in the Wild17 Jan 2025
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matching16 Jan 2025
- 2024Adaptive Stereo Depth Estimation with Multi-Spectral Images Across All Lighting Conditions6 Nov 2024
38 more
- 2024A Survey on Deep Stereo Matching in the Twenties10 Jul 2024
- 2024EgoFlowNet: Non-Rigid Scene Flow from Point Clouds with Ego-Motion Support3 Jul 2024
- 2024RMS-FlowNet++: Efficient and Robust Multi-Scale Scene Flow Estimation for Large-Scale Point Clouds1 Jul 2024
- 2024Virtually Enriched NYU Depth V2 Dataset for Monocular Depth Estimation: Do We Need Artificial Augmentation?15 Apr 2024
- 2024SDGE: Stereo Guided Depth Estimation for 360^circ Camera Sets19 Feb 2024
- 2024Dense Matchers for Dense Tracking17 Feb 2024
- 2024Seeing Objects in a Cluttered World: Computational Objectness from Motion in Video2 Feb 2024
- 2023OpenStereo: A Comprehensive Benchmark for Stereo Matching and Strong Baseline1 Dec 2023
- 2023CCMR: High Resolution Optical Flow Estimation via Coarse-to-Fine Context-Guided Motion Reasoning5 Nov 2023
- 2023RPEFlow: Multimodal Fusion of RGB-PointCloud-Event for Joint Optical Flow and Scene Flow Estimation26 Sep 2023
- 2023TSTTC: A Large-Scale Dataset for Time-to-Contact Estimation in Driving Scenarios4 Sep 2023
- 2023The Drunkard's Odometry: Estimating Camera Motion in Deforming Scenes29 Jun 2023
- 2023MFT: Long-Term Tracking of Every Pixel22 May 2023
- 2023Fully neuromorphic vision and control for autonomous drone flight15 Mar 2023
- 2023Hidden Gems: 4D Radar Scene Flow Learning Using Cross-Modal Supervision1 Mar 2023
- 2023Learning to Estimate Single-View Volumetric Flow Motions without 3D Supervision28 Feb 2023
- 2022Learning Dense and Continuous Optical Flow from an Event Camera16 Nov 2022
- 2022Self-supervised Amodal Video Object Segmentation23 Oct 2022
- 2022GMA3D: Local-Global Attention Learning to Estimate Occluded Motions of Scene Flow7 Oct 2022
- 2022DirectTracker: 3D Multi-Object Tracking Using Direct Image Alignment and Photometric Bundle Adjustment29 Sep 2022
- 20223D Scene Flow Estimation on Pseudo-LiDAR: Bridging the Gap on Estimating Point Motion27 Sep 2022
- 2022NanoFlowNet: Real-time Dense Optical Flow on a Nano Quadcopter14 Sep 2022
- 2022Unsupervised Flow Refinement near Motion Boundaries3 Aug 2022
- 2022EASNet: Searching Elastic and Accurate Network Architecture for Stereo Matching20 Jul 2022
- 2022What Matters for 3D Scene Flow Network19 Jul 2022
- 2022RGB-Multispectral Matching: Dataset, Learning Methodology, Evaluation14 Jun 2022
- 2022Unsupervised Learning of 3D Scene Flow from Monocular Camera8 Jun 2022
- 2022RMS-FlowNet: Efficient and Robust Multi-Scale Scene Flow Estimation for Large-Scale Point Clouds1 Apr 2022
- 2022Learning Optical Flow, Depth, and Scene Flow without Real-World Labels28 Mar 2022
- 2022Learning Scene Flow in 3D Point Clouds with Noisy Pseudo Labels23 Mar 2022
- 2022Optical Flow Training under Limited Label Budget via Active Learning9 Mar 2022
- 2022ChiTransformer:Towards Reliable Stereo from Cues9 Mar 2022
- 2022Learning Pixel Trajectories with Multiscale Contrastive Random Walks20 Jan 2022
- 2021Joint Detection of Motion Boundaries and Occlusions1 Nov 2021
- 2021Neural Disparity Refinement for Arbitrary Resolution Stereo28 Oct 2021
- 2021FADNet++: Real-Time and Accurate Disparity Estimation with Configurable Networks6 Oct 2021
- 2021Sensor-Guided Optical Flow30 Sep 2021
- 2021Residual 3D Scene Flow Learning with Context-Aware Feature Extraction10 Sep 2021
50 newest of 69 All 69 (JSON)
- 2021SMD-Nets: Stereo Mixture Density Networkscited by 118
- 2021MobileStereoNet: Towards Lightweight Deep Networks for Stereo Matchingcited by 82
- 2023MFT: Long-Term Tracking of Every Pixelcited by 61
- 2022Learning Dense and Continuous Optical Flow from an Event Cameracited by 59
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2022Learning Pixel Trajectories with Multiscale Contrastive Random Walkscited by 36
- 2023Hidden Gems: 4D Radar Scene Flow Learning Using Cross-Modal Supervisioncited by 36
- 2022Learning Optical Flow, Depth, and Scene Flow without Real-World Labelscited by 31
- 2022What Matters for 3D Scene Flow Networkcited by 31
- 2021FESTA: Flow Estimation via Spatial-Temporal Attention for Scene Point Cloudscited by 30
- 2023Fully neuromorphic vision and control for autonomous drone flightcited by 30
- 2021Self-Supervised Multi-Frame Monocular Scene Flowcited by 29
12 most cited of 68 All 68 (JSON)
- 2026STEMPix: A Phase-Transition-Material-Based Pixel Sensor for Resolving Edge-Movement Direction3 Sep 2026
- 2026MinNav: Minimalist Navigation Using Optical Flow For Active Tiny Aerial Robots5 Jun 2026
- 2026Flow of Truth: Proactive Temporal Forensics for Image-to-Video Generation16 Apr 2026
- 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matching10 Apr 2026
- 2026SF3D-RGB: Scene Flow Estimation from Monocular Camera and Sparse LiDAR25 Feb 2026
- 2026SRFlow: A Dataset and Regularization Model for High-Resolution Facial Optical Flow via Splatting Rasterization10 Jan 2026
- 2025What Makes Good Synthetic Training Data for Zero-Shot Stereo Matching?23 Apr 2025
- 2025ProbDiffFlow: An Efficient Learning-Free Framework for Probabilistic Single-Image Optical Flow Estimation16 Mar 2025
- 2025Zero-Shot Monocular Scene Flow Estimation in the Wild17 Jan 2025
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matching16 Jan 2025
- 2024Adaptive Stereo Depth Estimation with Multi-Spectral Images Across All Lighting Conditions6 Nov 2024
- 2024A Survey on Deep Stereo Matching in the Twenties10 Jul 2024
12 newest of 68 All 68 (JSON)