mlsanityData to 7 Oct 2026

MemoryMamba: Memory-Augmented State Space Model for Defect Recognition

arXiv 2405.03673 ↗First posted 6 May 2024cs.CV cs.AIcited by 24

Not on the map. Why?

Abstract (arXiv)

As automation advances in manufacturing, the demand for precise and sophisticated defect detection technologies grows. Existing vision models for defect recognition methods are insufficient for handling the complexities and variations of defects in contemporary manufacturing settings. These models especially struggle in scenarios involving limited or imbalanced defect data. In this work, we introduce MemoryMamba, a novel memory-augmented state space model (SSM), designed to overcome the limitations of existing defect recognition models. MemoryMamba integrates the state space model with the memory augmentation mechanism, enabling the system to maintain and retrieve essential defect-specific information in training. Its architecture is designed to capture dependencies and intricate defect characteristics, which are crucial for effective defect detection. In the experiments, MemoryMamba was evaluated across four industrial datasets with diverse defect types and complexities. The model consistently outperformed other methods, demonstrating its capability to adapt to various defect recognition scenarios.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 31 of its 63 references that are in the map. First posted on arXiv 6 May 2024.

Builds on

31 of 63 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  5. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  6. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  7. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  8. 2024VMamba: Visual State Space Modelcited by 955
  9. 2024A Survey on Visual Anomaly Detection: Challenge, Approach, and Prospectcited by 69
  10. 2024State Space Model for New-Generation Network Alternative to Transformers: A Surveycited by 59
  11. 2024Large Language Models for Forecasting and Anomaly Detection: A Systematic Literature Reviewcited by 50
  12. 2024UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentationcited by 45
19 more
  1. 2022Towards Robust Ranker for Text Retrievalcited by 37
  2. 2022Fine-Grained Distillation for Long Document Retrievalcited by 29
  3. 2023Bridging the Domain Gap: Self-Supervised 3D Scene Understanding with Foundation Modelscited by 26
  4. 2021Multimodal Semi-Supervised Learning for 3D Objectscited by 24
  5. 2024Residual-based Language Models are Free Boosters for Biomedical Imagingcited by 23
  6. 2024Adaptive Ensembles of Fine-Tuned Transformers for LLM-Generated Text Detectioncited by 22
  7. 2023Multimodal Event Transformer for Image-guided Story Ending Generationcited by 21
  8. 2023Style-Aware Contrastive Learning for Multi-Style Image Captioningcited by 21
  9. 2024Particle Filter SLAM for Vehicle Localizationcited by 20
  10. 2023Convolutional State Space Models for Long-Range Spatiotemporal Modelingcited by 19
  11. 2024SST: Multi-Scale Hybrid Mamba-Transformer Experts for Time Series Forecastingcited by 15
  12. 2024News Recommendation with Attention Mechanismcited by 14
  13. 2022Class-Level Confidence Based 3D Semi-Supervised Learningcited by 13
  14. 2024InsectMamba: Insect Pest Classification with State Space Modelcited by 11
  15. 2020Unsupervised machine learning via transfer learning and k-means clustering to classify materials image datacited by 10
  16. 2019Recognition Of Surface Defects On Steel Sheet Using Transfer Learningcited by 7
  17. 2022Recognition of Defective Mineral Wool Using Pruned ResNet Modelscited by 3
  18. 2022Automated Defect Recognition of Castings defects using Neural Networkscited by 2
  19. 2023Boosting Defect Detection in Manufacturing using Tensor Convolutional Neural Networkscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 12; 2025: 7; 2026: 5.

24 papers.

Sort:

By area:

  1. 2024Vision Mamba: A Comprehensive Survey and Taxonomycited by 53
  2. 2024A Survey of Mambacited by 39
  3. 2025TheraMind: A Strategic and Adaptive Agent for Longitudinal Psychological Counselingcited by 7
  4. 2025End-to-End Chart Summarization via Visual Chain-of-Thought in Vision-Language Modelscited by 3
  5. 2026Demystifying Low-Rank Knowledge Distillation in Large Language Models: Convergence, Generalization, and Information-Theoretic Guaranteescited by 3
  6. 2024MHS-VM: Multi-Head Scanning in Parallel Subspaces for Vision Mambacited by 2
  7. 2024Optimizing Psychological Counseling with Instruction-Tuned Large Language Modelscited by 2
  8. 2024Improving Visual Storytelling with Multimodal Large Language Modelscited by 2
  9. 2024Enhancing Scientific Figure Captioning Through Cross-modal Learningcited by 1
  10. 2024Enhancing Agricultural Machinery Management through Advanced LLM Integrationcited by 1
  11. 2025DocRefine: An Intelligent Framework for Scientific Document Understanding and Content Optimization based on Multimodal Large Model Agentscited by 1
  12. 2025Robust Diagram Reasoning: A Framework for Enhancing LVLM Performance on Visually Perturbed Scientific Diagramscited by 1
12 more
  1. 2024Fault Diagnosis in Power Grids with Large Language Modelcited by 0
  2. 2024LLMs for Enhanced Agricultural Meteorological Recommendationscited by 0
  3. 2024Enhancing AI-Driven Psychological Consultation: Layered Prompts with Large Language Modelscited by 0
  4. 2024Exploring Large Vision-Language Models for Robust and Efficient Industrial Anomaly Detectioncited by 0
  5. 2024Selective State Space Memory for Large Vision-Language Modelscited by 0
  6. 2025Cross-Domain Semantic Segmentation with Large Language Model-Assisted Descriptor Generationcited by 0
  7. 2025MM-FusionNet: Context-Aware Dynamic Fusion for Multi-modal Fake News Detection with Large Vision-Language Modelscited by 0
  8. 2025Context-Enhanced Granular Edit Representation for Efficient and Accurate ASR Post-editingcited by 0
  9. 2026AE-LLM: Adaptive Efficiency Optimization for Large Language Modelscited by 0
  10. 2026HierBias: Context-Conditioned Hierarchical Media Bias Detection with Multi-Task Type Classificationcited by 0
  11. 2026Spectral Origins of the Self-Correction Blind Spot in Autoregressive Generationcited by 0
  12. 2026When Does External Guidance Help LLM Reasoning? A Bias-Variance Theory of Guidance-Augmented GRPOcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Open-Vocabulary Industrial Defect Understanding with a Large-Scale Multimodal Dataset
  2. 2026GenAU: Language-Grounded Industrial Anomaly Understanding with Vision-Language Models
  3. 2026LDU-Bench: Multimodal LLM Evaluation for Lithography Defect Understanding under Layout-Varying Circuit Backgrounds
  4. 2026Spatial Attention Supervision for Defect Localization: Exploiting Ground-Truth Masks as Training Signal in Diffusion-Augmented Defect Detection
  5. 2025Triad: Empowering LMM-based Anomaly Detection with Vision Expert-guided Visual Tokenizer and Manufacturing Process
  6. 2026ConMem: Contribution-Aware Memory for Long-Horizon Manufacturing Inspection Logs
  7. 2026Detecting Defects that Matter: An Application-Driven Benchmark for Anomaly Detection in Manufacturing and Retail Logistics (VAND 4.0 Challenge)
  8. 2026A Hybrid Vision-Language Architecture for Automated Defect Reasoning and Report Generation in Industrial Inspection