mlsanityData to 14 Oct 2026

A Comparison of Deep Learning Architectures for Spacecraft Anomaly Detection

arXiv 2403.12864 ↗First posted 19 Mar 2024cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Spacecraft operations are highly critical, demanding impeccable reliability and safety. Ensuring the optimal performance of a spacecraft requires the early detection and mitigation of anomalies, which could otherwise result in unit or mission failures. With the advent of deep learning, a surge of interest has been seen in leveraging these sophisticated algorithms for anomaly detection in space operations. This study aims to compare the efficacy of various deep learning architectures in detecting anomalies in spacecraft data. The deep learning models under investigation include Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Long Short-Term Memory (LSTM) networks, and Transformer-based architectures. Each of these models was trained and validated using a comprehensive dataset sourced from multiple spacecraft missions, encompassing diverse operational scenarios and anomaly types. Initial results indicate that while CNNs excel in identifying spatial patterns and may be effective for some classes of spacecraft data, LSTMs and RNNs show a marked proficiency in capturing temporal anomalies seen in time-series spacecraft telemetry. The Transformer-based architectures, given their ability to focus on both local and global contexts, have showcased promising results, especially in scenarios where anomalies are subtle and span over longer durations. Additionally, considerations such as computational efficiency, ease of deployment, and real-time processing capabilities were evaluated. While CNNs and LSTMs demonstrated a balance between accuracy and computational demands, Transformer architectures, though highly accurate, require significant computational resources. In conclusion, the choice of deep learning architecture for spacecraft anomaly detection is highly contingent on the nature of the data, the type of anomalies, and operational constraints.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 22 of its 64 references that are in the map. First posted on arXiv 19 Mar 2024.

Builds on

22 of 64 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  4. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 453
  5. 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 410
  6. 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 394
  7. 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
  8. 2021Pay Attention to MLPscited by 368
  9. 2016Time Series Classification from Scratch with Deep Neural Networks: A Strong Baselinecited by 360
  10. 2018A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decaycited by 226
  11. 2020fastai: A Layered API for Deep Learningcited by 183
  12. 2022Local Evaluation of Time Series Anomaly Detection Algorithmscited by 79
10 more
  1. 2018Precision and Recall for Time Seriescited by 67
  2. 2018Multilevel Wavelet Decomposition Network for Interpretable Time Series Analysiscited by 61
  3. 2022FCN-Transformer Feature Fusion for Polyp Segmentationcited by 37
  4. 2021Fully Learnable Deep Wavelet Transform for Unsupervised Monitoring of High-Frequency Time Seriescited by 29
  5. 2023AnomalyBERT: Self-Supervised Transformer for Time Series Anomaly Detection using Data Degradation Schemecited by 25
  6. 2021A comparison of LSTM and GRU networks for learning symbolic sequencescited by 24
  7. 2022Scheduling Techniques for Liver Segmentation: ReduceLRonPlateau Vs OneCycleLRcited by 19
  8. 2019XceptionTime: A Novel Deep Architecture based on Depthwise Separable Convolutions for Hand Gesture Classificationcited by 17
  9. 2023Spacecraft Anomaly Detection with Attention Temporal Convolution Networkcited by 5
  10. 2020Leveraging Text Data Using Hybrid Transformer-LSTM Based End-to-End ASR in Transfer Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 1.

2 papers.