LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Tasks
Not on the map. Why?
Abstract (arXiv)
LangXAI is a framework that integrates Explainable Artificial Intelligence (XAI) with advanced vision models to generate textual explanations for visual recognition tasks. Despite XAI advancements, an understanding gap persists for end-users with limited domain knowledge in artificial intelligence and computer vision. LangXAI addresses this by furnishing text-based explanations for classification, object detection, and semantic segmentation model outputs to end-users. Preliminary results demonstrate LangXAI's enhanced plausibility, with high BERTScore across tasks, fostering a more transparent and reliable AI framework on vision tasks for end-users.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 27 of its 39 references that are in the map. First posted on arXiv 19 Feb 2024.
Builds on
27 of 39 references.
References · 27
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
15 more
- 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 188
- 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 151
- 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 118
- 2022PromptCap: Prompt-Guided Task-Aware Image Captioningcited by 104
- 2020Use HiResCAM instead of Grad-CAM for faithful explanations of convolutional neural networkscited by 79
- 2020Black-box Explanation of Object Detectors via Saliency Mapscited by 74
- 2020TTPLA: An Aerial-Image Dataset for Detection and Segmentation of Transmission Towers and Power Linescited by 28
- 2023Towards Better Explanations for Object Detectioncited by 14
- 2021Ada-SISE: Adaptive Semantic Input Sampling for Efficient Explanation of Convolutional Neural Networkscited by 11
- 2021EUCA: the End-User-Centered Explainable AI Frameworkcited by 10
- 2023Towards Trust of Explainable AI in Thyroid Nodule Diagnosiscited by 10
- 2023G-CAME: Gaussian-Class Activation Mapping Explainer for Object Detectorscited by 7
- 2023A Novel Explainable Artificial Intelligence Model in Image Classification problemcited by 3
- 2024XAI-Enhanced Semantic Segmentation Models for Visual Quality Inspectioncited by 1
- 2024Transforming gradient-based techniques into interpretable methodscited by 1
Built on by
Citing papers per year: 2024: 3; 2025: 7; 2026: 2.
12 papers.
- 2024XEdgeAI: A Human-centered Industrial Inspection Framework with Data-centric Explainable Edge AI Approachcited by 7
- 2025Motion2Meaning: A Clinician-Centered Framework for Contestable LLM in Parkinson's Disease Gait Interpretationcited by 6
- 2025Heart2Mind: Human-Centered Contestable Psychiatric Disorder Diagnosis System using Wearable ECG Monitorscited by 4
- 2025Multimedia Verification Through Multi-Agent Deep Research Multimodal Large Language Modelscited by 4
- 2025ODExAI: A Comprehensive Object Detection Explainable AI Evaluationcited by 3
- 2025SimInterview: Transforming Business Education through Large Language Model-Based Simulated Multilingual Interview Training Systemcited by 2
- 2024Advancing Histopathology-Based Breast Cancer Diagnosis: Insights into Multi-Modality and Explainabilitycited by 0
- 2024A Multi-Task Text Classification Pipeline with Natural Language Explanations: A User-Centric Evaluation in Sentiment Analysis and Offensive Language Identification in Greek Tweetscited by 0
- 2025GeoVision Labeler: Zero-Shot Geospatial Classification with Vision and Language Modelscited by 0
- 2025A Novel Framework for Automated Explain Vision Model Using Vision-Language Modelscited by 0
- 2026Concept-Enhanced Multimodal RAG: Towards Interpretable and Accurate Radiology Report Generationcited by 0
- 2026Multi-Dimensional Model Integrity and Responsibility Assessment Index and Scoring Frameworkcited by 0
- 2026Multi-Dimensional Model Integrity and Responsibility Assessment Index and Scoring Framework14 May 2026
- 2026Concept-Enhanced Multimodal RAG: Towards Interpretable and Accurate Radiology Report Generation17 Feb 2026
- 2025Motion2Meaning: A Clinician-Centered Framework for Contestable LLM in Parkinson's Disease Gait Interpretation21 Oct 2025
- 2025A Novel Framework for Automated Explain Vision Model Using Vision-Language Models27 Aug 2025
- 2025SimInterview: Transforming Business Education through Large Language Model-Based Simulated Multilingual Interview Training System16 Aug 2025
- 2025Multimedia Verification Through Multi-Agent Deep Research Multimodal Large Language Models6 Jul 2025
- 2025GeoVision Labeler: Zero-Shot Geospatial Classification with Vision and Language Models30 May 2025
- 2025Heart2Mind: Human-Centered Contestable Psychiatric Disorder Diagnosis System using Wearable ECG Monitors16 May 2025
- 2025ODExAI: A Comprehensive Object Detection Explainable AI Evaluation27 Apr 2025
- 2024A Multi-Task Text Classification Pipeline with Natural Language Explanations: A User-Centric Evaluation in Sentiment Analysis and Offensive Language Identification in Greek Tweets14 Oct 2024
- 2024XEdgeAI: A Human-centered Industrial Inspection Framework with Data-centric Explainable Edge AI Approach16 Jul 2024
- 2024Advancing Histopathology-Based Breast Cancer Diagnosis: Insights into Multi-Modality and Explainability7 Jun 2024