Robustifying Point Cloud Networks by Refocusing
Not on the map. Why?
Abstract (arXiv)
The ability to cope with out-of-distribution (OOD) corruptions and adversarial attacks is crucial in real-world safety-demanding applications. In this study, we develop a general mechanism to increase neural network robustness based on focus analysis. Recent studies have revealed the phenomenon of textitOverfocusing, which leads to a performance drop. When the network is primarily influenced by small input regions, it becomes less robust and prone to misclassify under noise and corruptions. However, quantifying overfocusing is still vague and lacks clear definitions. Here, we provide a mathematical definition of focus, overfocusing and underfocusing. The notions are general, but in this study, we specifically investigate the case of 3D point clouds. We observe that corrupted sets result in a biased focus distribution compared to the clean training set. We show that as focus distribution deviates from the one learned in the training phase - classification performance deteriorates. We thus propose a parameter-free refocusing algorithm that aims to unify all corruptions under the same distribution. We validate our findings on a 3D zero-shot classification task, achieving SOTA in robust 3D classification on ModelNet-C dataset, and in adversarial defense against Shape-Invariant attack. Code is available in: https://github.com/yossilevii100/refocusing.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 53 of its 67 references that are in the map. First posted on arXiv 10 Aug 2023.
Builds on
53 of 67 references.
References · 53
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2019Natural Adversarial Examplescited by 1,408
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 840
- 2020PCT: Point cloud transformercited by 732
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 724
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 627
- 2022Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Frameworkcited by 379
38 more
- 2019On the Relationship between Self-Attention and Convolutional Layerscited by 300
- 2019Analyzing the Structure of Attention in a Transformer Language Modelcited by 243
- 2020PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Samplingcited by 239
- 2021PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Cloudscited by 211
- 2021Walk in the Cloud: Learning Curves for Point Clouds Shape Analysiscited by 172
- 2018Generating 3D Adversarial Point Cloudscited by 144
- 2018PointCloud Saliency Mapscited by 112
- 2019PointCleanNet: Learning to Denoise and Remove Outliers from Dense Point Cloudscited by 99
- 2019Extending Adversarial Attacks and Defenses to Deep 3D Point Cloud Classifierscited by 92
- 2019AdvPC: Transferable Adversarial Perturbations on 3D Point Cloudscited by 84
- 2016Shape Completion Enabled Robotic Graspingcited by 79
- 2019SampleNet: Differentiable Point Cloud Samplingcited by 74
- 2020Learning Geometry-Disentangled Representation for Complementary Understanding of 3D Object Point Cloudcited by 71
- 2022Benchmarking and Analyzing Point Cloud Classification under Corruptionscited by 70
- 2021PointCutMix: Regularization Strategy for Point Cloud Classificationcited by 69
- 2019Adversarial Attack and Defense on Point Setscited by 63
- 2021Regularization Strategy for Point Cloud via Rigidly Mixed Samplecited by 59
- 2019Robustness of 3D Deep Learning in an Adversarial Settingcited by 55
- 2020LG-GAN: Label Guided Adversarial Network for Flexible Targeted Attack of Point Cloud-based Deep Networkscited by 55
- 2018A LiDAR Point Cloud Generator: from a Virtual World to Autonomous Drivingcited by 54
- 2021Less is More: Pay Less Attention in Vision Transformerscited by 53
- 2022Shape-invariant 3D Adversarial Point Cloudscited by 50
- 2021PointGuard: Provably Robust 3D Point Cloud Classificationcited by 49
- 2019PointHop: An Explainable Machine Learning Method for Point Cloud Classificationcited by 46
- 2020On Isometry Robustness of Deep 3D Point Cloud Models under Adversarial Attackscited by 46
- 2020IF-Defense: 3D Adversarial Point Cloud Defense via Implicit Function based Restorationcited by 46
- 2020Minimal Adversarial Examples for Deep Learning on 3D Point Cloudscited by 41
- 2021Point Cloud Augmentation with Weighted Local Transformationscited by 39
- 2017What does Attention in Neural Machine Translation Pay Attention to?cited by 30
- 2020ShapeAdv: Generating Shape-Aware Adversarial 3D Point Cloudscited by 20
- 2023Robustifying Token Attention for Vision Transformerscited by 19
- 2021Surrogate Model-Based Explainability Methods for Point Cloud NNscited by 18
- 20203D Point Cloud Feature Explanations Using Gradient-Based Methodscited by 14
- 2022LPF-Defense: 3D Adversarial Defense based on Frequency Analysiscited by 10
- 2021Explainability-Aware One Point Attack for Point Cloud Neural Networkscited by 7
- 2023PointCert: Point Cloud Classification with Deterministic Certified Robustness Guaranteescited by 6
- 2023EPiC: Ensemble of Partial Point Clouds for Robust Classificationcited by 5
- 2021CloudWalker: Random walks for 3D point cloud shape analysiscited by 4
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 1.
2 papers.