XEdgeAI: A Human-centered Industrial Inspection Framework with Data-centric Explainable Edge AI Approach
Not on the map. Why?
Abstract (arXiv)
Recent advancements in deep learning have significantly improved visual quality inspection and predictive maintenance within industrial settings. However, deploying these technologies on low-resource edge devices poses substantial challenges due to their high computational demands and the inherent complexity of Explainable AI (XAI) methods. This paper addresses these challenges by introducing a novel XAI-integrated Visual Quality Inspection framework that optimizes the deployment of semantic segmentation models on low-resource edge devices. Our framework incorporates XAI and the Large Vision Language Model to deliver human-centered interpretability through visual and textual explanations to end-users. This is crucial for end-user trust and model interpretability. We outline a comprehensive methodology consisting of six fundamental modules: base model fine-tuning, XAI-based explanation generation, evaluation of XAI approaches, XAI-guided data augmentation, development of an edge-compatible model, and the generation of understandable visual and textual explanations. Through XAI-guided data augmentation, the enhanced model incorporating domain expert knowledge with visual and textual explanations is successfully deployed on mobile devices to support end-users in real-world scenarios. Experimental results showcase the effectiveness of the proposed framework, with the mobile model achieving competitive accuracy while significantly reducing model size. This approach paves the way for the broader adoption of reliable and interpretable AI tools in critical industrial applications, where decisions must be both rapid and justifiable. Our code for this work can be found at https://github.com/Analytics-Everywhere-Lab/vqixai.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 68 of its 120 references that are in the map. First posted on arXiv 16 Jul 2024.
Builds on
68 of 120 references.
References · 68
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
38 more
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2019Searching for MobileNetV3cited by 1,984
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 762
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 575
- 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 560
- 2018Albumentations: fast and flexible image augmentationscited by 558
- 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 467
- 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 416
- 2016Top-down Neural Attention by Excitation Backpropcited by 318
- 2018Textual Explanations for Self-Driving Vehiclescited by 226
- 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 188
- 2018Multimodal Explanations: Justifying Decisions and Pointing to the Evidencecited by 179
- 2024InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDcited by 156
- 2020Axiom-based Grad-CAM: Towards Accurate Visualization and Explanation of CNNscited by 151
- 2019Interpretations are useful: penalizing explanations to align neural networks with prior knowledgecited by 144
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
- 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 118
- 2020Restricting the Flow: Information Bottlenecks for Attributioncited by 110
- 2018Grounding Visual Explanationscited by 92
- 2019Pruning by Explaining: A Novel Criterion for Deep Neural Network Pruningcited by 89
- 2020Explainable Object-induced Action Decision for Autonomous Vehiclescited by 88
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2020Black-box Explanation of Object Detectors via Saliency Mapscited by 74
- 2019Incorporating Priors with Feature Attribution on Text Classificationcited by 68
- 2020There and Back Again: Revisiting Backpropagation Saliency Methodscited by 60
- 2020Explanation-Guided Training for Cross-Domain Few-Shot Classificationcited by 58
- 2020Towards Interpretable Semantic Segmentation via Gradient-weighted Class Activation Mappingcited by 49
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2025: 6; 2026: 1.
7 papers.
- 2025Motion2Meaning: A Clinician-Centered Framework for Contestable LLM in Parkinson's Disease Gait Interpretationcited by 6
- 2025Heart2Mind: Human-Centered Contestable Psychiatric Disorder Diagnosis System using Wearable ECG Monitorscited by 4
- 2025ODExAI: A Comprehensive Object Detection Explainable AI Evaluationcited by 3
- 2025SimInterview: Transforming Business Education through Large Language Model-Based Simulated Multilingual Interview Training Systemcited by 2
- 2025Edge Artificial Intelligence: A Systematic Review of Evolution, Taxonomic Frameworks, and Future Horizonscited by 2
- 2025Explaining AI Without Code: A User Study on Explainable AIcited by 0
- 2026Multi-Dimensional Model Integrity and Responsibility Assessment Index and Scoring Frameworkcited by 0
- 2026Multi-Dimensional Model Integrity and Responsibility Assessment Index and Scoring Framework14 May 2026
- 2025Explaining AI Without Code: A User Study on Explainable AI28 Dec 2025
- 2025Motion2Meaning: A Clinician-Centered Framework for Contestable LLM in Parkinson's Disease Gait Interpretation21 Oct 2025
- 2025Edge Artificial Intelligence: A Systematic Review of Evolution, Taxonomic Frameworks, and Future Horizons1 Oct 2025
- 2025SimInterview: Transforming Business Education through Large Language Model-Based Simulated Multilingual Interview Training System16 Aug 2025
- 2025Heart2Mind: Human-Centered Contestable Psychiatric Disorder Diagnosis System using Wearable ECG Monitors16 May 2025
- 2025ODExAI: A Comprehensive Object Detection Explainable AI Evaluation27 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2026Adapting Vision-Language Models for Human-Readable XAI in Industrial Object Detection
- 2026A Hybrid Vision-Language Architecture for Automated Defect Reasoning and Report Generation in Industrial Inspection
- 2025InspectVLM: Unified in Theory, Unreliable in Practice
- 2026Unification of Closed-Open Industrial Detection Scenarios: New Large-Scale Benchmarks,Challenges and Baselines
- 2024Benchmarking XAI Explanations with Human-Aligned Evaluations
- 2025Towards Open-Vocabulary Industrial Defect Understanding with a Large-Scale Multimodal Dataset
- 2026UniPCB: A Unified Vision-Language Benchmark for Open-Ended PCB Quality Inspection
- 2026Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space