Towards Understanding Adversarial Robustness of Optical Flow Networks
Not on the map. Why?
Abstract (arXiv)
Recent work demonstrated the lack of robustness of optical flow networks to physical patch-based adversarial attacks. The possibility to physically attack a basic component of automotive systems is a reason for serious concerns. In this paper, we analyze the cause of the problem and show that the lack of robustness is rooted in the classical aperture problem of optical flow estimation in combination with bad choices in the details of the network architecture. We show how these mistakes can be rectified in order to make optical flow networks robust to physical patch-based attacks. Additionally, we take a look at global white-box attacks in the scope of optical flow. We find that targeted white-box attacks can be crafted to bias flow estimation models towards any desired output, but this requires access to the input images and model weights. However, in the case of universal attacks, we find that optical flow networks are robust. Code is available at https://github.com/lmb-freiburg/understanding_flow_robustness.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 24 of its 39 references that are in the map. First posted on arXiv 30 Mar 2021.
Builds on
24 of 39 references.
References · 24
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2013Intriguing properties of neural networkscited by 5,155
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2019Natural Adversarial Examplescited by 1,408
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,268
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
- 2016Adversarial Machine Learning at Scalecited by 936
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2016Universal adversarial perturbationscited by 784
12 more
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2017One pixel attack for fooling deep neural networkscited by 582
- 2017Adversarial Patchcited by 517
- 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 424
- 2019Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Comingcited by 336
- 2019Adversarial Attacks and Defenses in Images, Graphs and Text: A Reviewcited by 237
- 2017Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Ratescited by 199
- 2018Models Matter, So Does Training: An Empirical Study of CNNs for Optical Flow Estimationcited by 94
- 2017Universal Adversarial Perturbations Against Semantic Image Segmentationcited by 92
- 2019Attacking Optical Flowcited by 41
- 2018On the Robustness of the CVPR 2018 White-Box Adversarial Example Defensescited by 40
- 2020Stereopagnosia: Fooling Stereo Networks with Adversarial Perturbationscited by 19
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 5; 2024: 3; 2025: 4.
15 papers.
Sort:
By area:
- 2025Towards Understanding Subliminal Learning: When and How Hidden Biases Transfercited by 34
- 2023CosPGD: an efficient white-box adversarial attack for pixel-wise prediction taskscited by 27
- 2022A Perturbation-Constrained Adversarial Attack for Evaluating the Robustness of Optical Flowcited by 16
- 2023Distracting Downpour: Adversarial Weather Attacks for Motion Estimationcited by 15
- 2023DistractFlow: Improving Optical Flow Estimation via Realistic Distractions and Pseudo-Labelingcited by 14
- 2022Attacking Motion Estimation with Adversarial Snowcited by 9
- 2025When and How Does CLIP Enable Domain and Compositional Generalization?cited by 9
- 2023DIFT: Dynamic Iterative Field Transforms for Memory Efficient Optical Flowcited by 7
- 2025RobustSpring: Benchmarking Robustness to Image Corruptions for Optical Flow, Scene Flow and Stereocited by 7
- 2023Detection Defenses: An Empty Promise against Adversarial Patch Attacks on Optical Flowcited by 6
- 2024Beware of Aliases -- Signal Preservation is Crucial for Robust Image Restorationcited by 6
- 2021Consistent Semantic Attacks on Optical Flowcited by 4
- 2025Test-Time Defense Against Adversarial Attacks via Stochastic Resonance of Latent Ensembles3 Oct 2025
- 2025Towards Understanding Subliminal Learning: When and How Hidden Biases Transfer28 Sep 2025
- 2025RobustSpring: Benchmarking Robustness to Image Corruptions for Optical Flow, Scene Flow and Stereo14 May 2025
- 2025When and How Does CLIP Enable Domain and Compositional Generalization?13 Feb 2025
- 2024Towards Dependable Optical Flow: Benchmarks for Real-World Spatiotemporal Corruptions22 Nov 2024
- 2024Beware of Aliases -- Signal Preservation is Crucial for Robust Image Restoration11 Jun 2024
- 2024Left-right Discrepancy for Adversarial Attack on Stereo Networks14 Jan 2024
- 2023Detection Defenses: An Empty Promise against Adversarial Patch Attacks on Optical Flow26 Oct 2023
- 2023DIFT: Dynamic Iterative Field Transforms for Memory Efficient Optical Flow9 Jun 2023
- 2023Distracting Downpour: Adversarial Weather Attacks for Motion Estimation11 May 2023
- 2023DistractFlow: Improving Optical Flow Estimation via Realistic Distractions and Pseudo-Labeling24 Mar 2023
- 2023CosPGD: an efficient white-box adversarial attack for pixel-wise prediction tasks4 Feb 2023
3 more
- 2023CosPGD: an efficient white-box adversarial attack for pixel-wise prediction taskscited by 27
- 2022A Perturbation-Constrained Adversarial Attack for Evaluating the Robustness of Optical Flowcited by 16
- 2023Distracting Downpour: Adversarial Weather Attacks for Motion Estimationcited by 15
- 2023DistractFlow: Improving Optical Flow Estimation via Realistic Distractions and Pseudo-Labelingcited by 14
- 2022Attacking Motion Estimation with Adversarial Snowcited by 9
- 2023DIFT: Dynamic Iterative Field Transforms for Memory Efficient Optical Flowcited by 7
- 2025RobustSpring: Benchmarking Robustness to Image Corruptions for Optical Flow, Scene Flow and Stereocited by 7
- 2023Detection Defenses: An Empty Promise against Adversarial Patch Attacks on Optical Flowcited by 6
- 2024Beware of Aliases -- Signal Preservation is Crucial for Robust Image Restorationcited by 6
- 2021Consistent Semantic Attacks on Optical Flowcited by 4
- 2024Towards Dependable Optical Flow: Benchmarks for Real-World Spatiotemporal Corruptionscited by 3
- 2024Left-right Discrepancy for Adversarial Attack on Stereo Networkscited by 2
12 most cited of 13 All 13 (JSON)
- 2025Test-Time Defense Against Adversarial Attacks via Stochastic Resonance of Latent Ensembles3 Oct 2025
- 2025RobustSpring: Benchmarking Robustness to Image Corruptions for Optical Flow, Scene Flow and Stereo14 May 2025
- 2024Towards Dependable Optical Flow: Benchmarks for Real-World Spatiotemporal Corruptions22 Nov 2024
- 2024Beware of Aliases -- Signal Preservation is Crucial for Robust Image Restoration11 Jun 2024
- 2024Left-right Discrepancy for Adversarial Attack on Stereo Networks14 Jan 2024
- 2023Detection Defenses: An Empty Promise against Adversarial Patch Attacks on Optical Flow26 Oct 2023
- 2023DIFT: Dynamic Iterative Field Transforms for Memory Efficient Optical Flow9 Jun 2023
- 2023Distracting Downpour: Adversarial Weather Attacks for Motion Estimation11 May 2023
- 2023DistractFlow: Improving Optical Flow Estimation via Realistic Distractions and Pseudo-Labeling24 Mar 2023
- 2023CosPGD: an efficient white-box adversarial attack for pixel-wise prediction tasks4 Feb 2023
- 2022Attacking Motion Estimation with Adversarial Snow20 Oct 2022
- 2022A Perturbation-Constrained Adversarial Attack for Evaluating the Robustness of Optical Flow24 Mar 2022
12 newest of 13 All 13 (JSON)