mlsanityData to 7 Oct 2026

Towards Better Analysis of Deep Convolutional Neural Networks

arXiv 1604.07043 ↗First posted 24 Apr 2016cs.CVcited by 51

Not on the map. Why?

Abstract (arXiv)

Deep convolutional neural networks (CNNs) have achieved breakthrough performance in many pattern recognition tasks such as image classification. However, the development of high-quality deep models typically relies on a substantial amount of trial-and-error, as there is still no clear understanding of when and why a deep model works. In this paper, we present a visual analytics approach for better understanding, diagnosing, and refining deep CNNs. We formulate a deep CNN as a directed acyclic graph. Based on this formulation, a hybrid visualization is developed to disclose the multiple facets of each neuron and the interactions between them. In particular, we introduce a hierarchical rectangle packing algorithm and a matrix reordering algorithm to show the derived features of a neuron cluster. We also propose a biclustering-based edge bundling method to reduce visual clutter caused by a large number of connections between neurons. We evaluated our method on a set of CNNs and the results are generally favorable.

Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Apr 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 8; 2022: 11; 2023: 10; 2024: 10; 2025: 5; 2026: 7.

51 papers.

Sort:

By area:

  1. 2022From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagationcited by 141
  2. 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
  3. 2023Foundation Models Meet Visualizations: Challenges and Opportunitiescited by 31
  4. 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizationscited by 29
  5. 2023How Does Attention Work in Vision Transformers? A Visual Analytics Attemptcited by 29
  6. 2022Aligning Eyes between Humans and Deep Neural Network through Interactive Attention Alignmentcited by 27
  7. 2023Visual Analytics For Machine Learning: A Data Perspective Surveycited by 25
  8. 2021VisQA: X-raying Vision and Language Reasoning in Transformerscited by 19
  9. 2022Diagnosing Ensemble Few-Shot Classifierscited by 13
  10. 2021VAC-CNN: A Visual Analytics System for Comparative Studies of Deep Convolutional Neural Networkscited by 11
  11. 2021Towards Visual Explainable Active Learning for Zero-Shot Classificationcited by 10
  12. 2024Human-Guided Image Generation for Expanding Small-Scale Training Image Datasetscited by 10
38 more
  1. 2022Learning-From-Disagreement: A Model Comparison and Visual Analytics Frameworkcited by 9
  2. 2023G2uardFL: Safeguarding Federated Learning Against Backdoor Attacks through Attributed Client Graph Clusteringcited by 9
  3. 2023Towards an Understanding and Explanation for Mixed-Initiative Artificial Scientific Text Detectioncited by 8
  4. 2023A Unified Interactive Model Evaluation for Classification, Object Detection, and Instance Segmentation in Computer Visioncited by 8
  5. 2021Explainable Adversarial Attacks in Deep Neural Networks Using Activation Profilescited by 6
  6. 2022A Visual Analytics System for Improving Attention-based Traffic Forecasting Modelscited by 6
  7. 2021VERB: Visualizing and Interpreting Bias Mitigation Techniques for Word Representationscited by 3
  8. 2021SIM2REALVIZ: Visualizing the Sim2Real Gap in Robot Ego-Pose Estimationcited by 3
  9. 2022Visual Analysis of Neural Architecture Spaces for Summarizing Design Principlescited by 3
  10. 2023Mitigating Backdoors in Federated Learning with FLDcited by 3
  11. 2023Are We Closing the Loop Yet? Gaps in the Generalizability of VIS4ML Researchcited by 3
  12. 2024EL-VIT: Probing Vision Transformer with Interactive Visualizationcited by 3
  13. 2025Illuminating LLM Coding Agents: Visual Analytics for Deeper Understanding and Enhancementcited by 3
  14. 2021DeepEverest: Accelerating Declarative Top-K Queries for Deep Neural Network Interpretationcited by 2
  15. 2022Testing Feedforward Neural Networks Training Programscited by 2
  16. 2024SingVisio: Visual Analytics of Diffusion Model for Singing Voice Conversioncited by 2
  17. 2024DNN Modularization via Activation-Driven Trainingcited by 2
  18. 2024FaceX: Understanding Face Attribute Classifiers through Summary Model Explanationscited by 2
  19. 2021Inference Graphs for CNN Interpretationcited by 1
  20. 2022ViNNPruner: Visual Interactive Pruning for Deep Learningcited by 1
  21. 2022An Interactive Interpretability System for Breast Cancer Screening with Deep Learningcited by 1
  22. 2023Towards Better Modeling with Missing Data: A Contrastive Learning-based Visual Analytics Perspectivecited by 1
  23. 2024MiMICRI: Towards Domain-centered Counterfactual Explanations of Cardiovascular Image Classification Modelscited by 1
  24. 2024RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifierscited by 1
  25. 2025A Rigorous Behavior Assessment of CNNs Using a Data-Domain Sampling Regimecited by 1
  26. 2025HOLE: Homological Observation of Latent Embeddings for Neural Network Interpretabilitycited by 1
  27. 2026KEditVis: A Visual Analytics System for Knowledge Editing of Large Language Modelscited by 1
  28. 2026Detect Anything in Graphic Design: Element-Level Rewards for Autoregressive Detectioncited by 1
  29. 2022Towards Efficient Visual Simplification of Computational Graphs in Deep Neural Networkscited by 0
  30. 2023MultiCaM-Vis: Visual Exploration of Multi-Classification Model with High Number of Classescited by 0
  31. 2024Disentangling Regional Primitives for Image Generationcited by 0
  32. 2024TA3: Testing Against Adversarial Attacks on Machine Learning Modelscited by 0
  33. 2025A Visual Tool for Interactive Model Explanation using Sensitivity Analysiscited by 0
  34. 2025Towards Explainable Quantum AI: Informing the Encoder Selection of Quantum Neural Networks via Visualizationcited by 0
  35. 2026SketchXplain: Intuitive Visual Explanations of Image Classifiers with Sketchescited by 0
  36. 2026Token Signatures of Code: Comparing Coding Behaviors Across Large Language Modelscited by 0
  37. 2026PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretrainingcited by 0
  38. 2026WidgetVA: A Widget-Centric Framework and Benchmark for Agentic Visual Analyticscited by 0

50 most cited of 51 All 51 (JSON)