Adapting Visualization Techniques for Time-Series Anomaly Detection: From Convolutional Neural Networks to Convolutional-Recurrent Neural Networks
Not on the map. Why?
Abstract (arXiv)
Deep neural networks achieve strong performance on complex tasks but are often regarded as "black boxes," which limits their adoption in domains where transparency is essential. This lack of interpretability raises ethical and legal concerns, particularly in sensitive applications such as security, where automated decisions can have serious consequences. The General Data Protection Regulation (GDPR) reinforces the need to justify decisions made by these systems. In this work, we investigate visualization techniques to improve the interpretability of anomaly detection models based on convolutional recurrent neural networks (CNN+RNN) with a TimeDistributed layer. Our architecture combines Visual Geometry Group 19 (VGG19) for feature extraction with a Gated Recurrent Unit (GRU) for sequential analysis of real-time video data. While this design is well suited for temporal inputs, the TimeDistributed layer complicates gradient propagation and weakens the link between spatial and temporal information, reducing the effectiveness of standard visualization methods. To address this challenge, we adapt techniques such as saliency maps and Gradient-weighted Class Activation Mapping (Grad-CAM) to models that incorporate a temporal dimension. Although dedicated visualization methods for such architectures remain limited, our study highlights both the difficulties and the potential of applying tools originally designed for static images to recurrent convolutional networks handling video sequences. This approach extends classical interpretation strategies to temporal models and provides an intermediate solution until more specialized methods are developed.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 38 references that are in the map. First posted on arXiv 7 Nov 2024.
Builds on
21 of 38 references.
References · 21
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
- 2020Understanding the Role of Individual Units in a Deep Neural Networkcited by 254
9 more
- 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 188
- 2017Interpretable Convolutional Neural Networkscited by 161
- 2019Efficient Saliency Maps for Explainable AIcited by 30
- 2020M3d-CAM: A PyTorch library to generate 3D data attention maps for medical deep learningcited by 12
- 2022Poly-CAM: High resolution class activation map for convolutional neural networkscited by 10
- 2023Class-Discriminative Attention Maps for Vision Transformerscited by 10
- 2022TimeREISE: Time-series Randomized Evolving Input Sample Explanationcited by 6
- 2024AXIAL: Attention-based eXplainability for Interpretable Alzheimer's Localized Diagnosis using 2D CNNs on 3D MRI brain scanscited by 4
- 2022Adaptive occlusion sensitivity analysis for visually explaining video recognition networkscited by 2
Built on by
Not cited yet.