Towards Robust Pattern Recognition: A Review
Not on the map. Why?
Abstract (arXiv)
The accuracies for many pattern recognition tasks have increased rapidly year by year, achieving or even outperforming human performance. From the perspective of accuracy, pattern recognition seems to be a nearly-solved problem. However, once launched in real applications, the high-accuracy pattern recognition systems may become unstable and unreliable, due to the lack of robustness in open and changing environments. In this paper, we present a comprehensive review of research towards robust pattern recognition from the perspective of breaking three basic and implicit assumptions: closed-world assumption, independent and identically distributed assumption, and clean and big data assumption, which form the foundation of most pattern recognition models. Actually, our brain is robust at learning concepts continually and incrementally, in complex, open and changing environments, with different contexts, modalities and tasks, by showing only a few examples, under weak or noisy supervision. These are the major differences between human intelligence and machine intelligence, which are closely related to the above three assumptions. After witnessing the significant progress in accuracy improvement nowadays, this review paper will enable us to analyze the shortcomings and limitations of current methods and identify future research directions for robust pattern recognition.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 6; 2023: 4; 2024: 4; 2025: 5; 2026: 2.
31 papers.
Sort:
By area:
- 2021A Review on Explainability in Multimodal Deep Neural Netscited by 46
- 2022A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologiescited by 44
- 2023OpenMix: Exploring Outlier Samples for Misclassification Detectioncited by 38
- 2021Multi-View Correlation Distillation for Incremental Object Detectioncited by 36
- 2021LTD: Low Temperature Distillation for Gradient Masking-free Adversarial Trainingcited by 13
- 2025Federated Continual Instruction Tuningcited by 10
- 2021Deep Learning for Scene Classification: A Surveycited by 9
- 2025Continual Learning for Generative AI: From LLMs to MLLMs and Beyondcited by 9
- 2021A Survey of Orthogonal Moments for Image Representation: Theory, Implementation, and Evaluationcited by 8
- 2022A Principled Design of Image Representation: Towards Forensic Taskscited by 8
- 2022Open-set Text Recognition via Character-Context Decouplingcited by 8
- 2022Adversarial Parameter Attack on Deep Neural Networkscited by 6
19 more
- 2024Typicalness-Aware Learning for Failure Detectioncited by 6
- 2021An End-to-End Computer Vision Methodology for Quantitative Metallographycited by 3
- 2023Learning Large Margin Sparse Embeddings for Open Set Medical Diagnosiscited by 3
- 2021Robust and Information-theoretically Safe Bias Classifier against Adversarial Attackscited by 2
- 2022Mutual Information Learned Classifiers: an Information-theoretic Viewpoint of Training Deep Learning Classification Systemscited by 2
- 2023Representing Noisy Image Without Denoisingcited by 2
- 2024Improving Taxonomic Image-based Out-of-distribution Detection With DNA Barcodescited by 2
- 2021A Robust Classification-autoencoder to Defend Outliers and Adversariescited by 1
- 2021Selective Probabilistic Classifier Based on Hypothesis Testingcited by 0
- 2021A Mathematical Foundation for Robust Machine Learning based on Bias-Variance Trade-offcited by 0
- 2022Mutual Information Learned Classifiers: an Information-theoretic Viewpoint of Training Deep Learning Classification Systemscited by 0
- 2023License Plate Recognition Based On Multi-Angle View Modelcited by 0
- 2024YOLOOC: YOLO-based Open-Class Incremental Object Detection with Novel Class Discoverycited by 0
- 2024Robust Capped lp-Norm Support Vector Ordinal Regressioncited by 0
- 2025Identifying Information from Observations with Uncertainty and Noveltycited by 0
- 2025Semi-parametric Memory Consolidation: Towards Brain-like Deep Continual Learningcited by 0
- 2025Insect-Wing Structured Microfluidic System for Reservoir Computingcited by 0
- 2026FuDU: A Fuzzy Dual-dimensional Uncertainty Framework for Streaming Active Learning in Industrial Defect Detectioncited by 0
- 2026Robust Online Aero-Engine Blade Defect Detection via Dual-Alignment Test-Time Adaptationcited by 0
- 2026Robust Online Aero-Engine Blade Defect Detection via Dual-Alignment Test-Time Adaptation4 Sep 2026
- 2026FuDU: A Fuzzy Dual-dimensional Uncertainty Framework for Streaming Active Learning in Industrial Defect Detection2 Sep 2026
- 2025Insect-Wing Structured Microfluidic System for Reservoir Computing1 Aug 2025
- 2025Continual Learning for Generative AI: From LLMs to MLLMs and Beyond16 Jun 2025
- 2025Semi-parametric Memory Consolidation: Towards Brain-like Deep Continual Learning20 Apr 2025
- 2025Federated Continual Instruction Tuning17 Mar 2025
- 2025Identifying Information from Observations with Uncertainty and Novelty16 Jan 2025
- 2024Typicalness-Aware Learning for Failure Detection4 Nov 2024
- 2024Improving Taxonomic Image-based Out-of-distribution Detection With DNA Barcodes27 Jun 2024
- 2024Robust Capped lp-Norm Support Vector Ordinal Regression25 Apr 2024
- 2024YOLOOC: YOLO-based Open-Class Incremental Object Detection with Novel Class Discovery30 Mar 2024
- 2023License Plate Recognition Based On Multi-Angle View Model22 Sep 2023
19 more
- 2023Learning Large Margin Sparse Embeddings for Open Set Medical Diagnosis10 Jul 2023
- 2023OpenMix: Exploring Outlier Samples for Misclassification Detection30 Mar 2023
- 2023Representing Noisy Image Without Denoising18 Jan 2023
- 2022Mutual Information Learned Classifiers: an Information-theoretic Viewpoint of Training Deep Learning Classification Systems3 Oct 2022
- 2022Mutual Information Learned Classifiers: an Information-theoretic Viewpoint of Training Deep Learning Classification Systems21 Sep 2022
- 2022Open-set Text Recognition via Character-Context Decoupling12 Apr 2022
- 2022A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologies26 Mar 2022
- 2022Adversarial Parameter Attack on Deep Neural Networks20 Mar 2022
- 2022A Principled Design of Image Representation: Towards Forensic Tasks2 Mar 2022
- 2021Robust and Information-theoretically Safe Bias Classifier against Adversarial Attacks8 Nov 2021
- 2021LTD: Low Temperature Distillation for Gradient Masking-free Adversarial Training3 Nov 2021
- 2021Multi-View Correlation Distillation for Incremental Object Detection5 Jul 2021
- 2021A Robust Classification-autoencoder to Defend Outliers and Adversaries30 Jun 2021
- 2021A Mathematical Foundation for Robust Machine Learning based on Bias-Variance Trade-off10 Jun 2021
- 2021A Review on Explainability in Multimodal Deep Neural Nets17 May 2021
- 2021Selective Probabilistic Classifier Based on Hypothesis Testing9 May 2021
- 2021An End-to-End Computer Vision Methodology for Quantitative Metallography22 Apr 2021
- 2021A Survey of Orthogonal Moments for Image Representation: Theory, Implementation, and Evaluation27 Mar 2021
- 2021Deep Learning for Scene Classification: A Survey26 Jan 2021
- 2025Federated Continual Instruction Tuningcited by 10
- 2025Federated Continual Instruction Tuning17 Mar 2025
- 2021A Review on Explainability in Multimodal Deep Neural Netscited by 46
- 2022A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologiescited by 44
- 2023OpenMix: Exploring Outlier Samples for Misclassification Detectioncited by 38
- 2021Multi-View Correlation Distillation for Incremental Object Detectioncited by 36
- 2021LTD: Low Temperature Distillation for Gradient Masking-free Adversarial Trainingcited by 13
- 2021Deep Learning for Scene Classification: A Surveycited by 9
- 2025Continual Learning for Generative AI: From LLMs to MLLMs and Beyondcited by 9
- 2021A Survey of Orthogonal Moments for Image Representation: Theory, Implementation, and Evaluationcited by 8
- 2022A Principled Design of Image Representation: Towards Forensic Taskscited by 8
- 2022Open-set Text Recognition via Character-Context Decouplingcited by 8
- 2022Adversarial Parameter Attack on Deep Neural Networkscited by 6
- 2024Typicalness-Aware Learning for Failure Detectioncited by 6
12 most cited of 30 All 30 (JSON)
- 2026Robust Online Aero-Engine Blade Defect Detection via Dual-Alignment Test-Time Adaptation4 Sep 2026
- 2026FuDU: A Fuzzy Dual-dimensional Uncertainty Framework for Streaming Active Learning in Industrial Defect Detection2 Sep 2026
- 2025Insect-Wing Structured Microfluidic System for Reservoir Computing1 Aug 2025
- 2025Continual Learning for Generative AI: From LLMs to MLLMs and Beyond16 Jun 2025
- 2025Semi-parametric Memory Consolidation: Towards Brain-like Deep Continual Learning20 Apr 2025
- 2025Identifying Information from Observations with Uncertainty and Novelty16 Jan 2025
- 2024Typicalness-Aware Learning for Failure Detection4 Nov 2024
- 2024Improving Taxonomic Image-based Out-of-distribution Detection With DNA Barcodes27 Jun 2024
- 2024Robust Capped lp-Norm Support Vector Ordinal Regression25 Apr 2024
- 2024YOLOOC: YOLO-based Open-Class Incremental Object Detection with Novel Class Discovery30 Mar 2024
- 2023License Plate Recognition Based On Multi-Angle View Model22 Sep 2023
- 2023Learning Large Margin Sparse Embeddings for Open Set Medical Diagnosis10 Jul 2023
12 newest of 30 All 30 (JSON)