mlsanityData to 14 Oct 2026

A Self-Supervised Framework for Space Object Behaviour Characterisation

arXiv 2504.06176 ↗First posted 8 Apr 2025cs.LG cs.AI physics.space-phcited by 0

Not on the map. Why?

Abstract (arXiv)

Foundation Models, which leverage large neural networks pre-trained on unlabelled data before fine-tuning for specific tasks, are increasingly being applied to specialised domains. Recent examples include ClimaX for climate and Clay for satellite Earth observation, but a Foundation Model for Space Object Behavioural Analysis has not yet been developed. As orbital populations grow, automated methods for characterising space object behaviour are crucial for space safety. Here, we present a self-supervised framework for space object behavioural analysis, representing a first step towards a Foundation Model for SOBA. The backbone is a Perceiver-Variational Autoencoder (VAE) architecture, pre-trained with self-supervised reconstruction and masked reconstruction on ~227,000 light curves from the MMT-9 observatory. The VAE enables anomaly detection, motion prediction, and synthetic light curve generation. We fine-tuned the model using two independent light curve simulators (CASSANDRA and GRIAL), with CAD models of boxwing, Sentinel-3, SMOS, and Starlink platforms. Our pre-trained model achieved a reconstruction mean squared error of 0.0012, identifying potentially anomalous light curves through reconstruction difficulty. After fine-tuning, the model scored 85% and 82% accuracy, with 0.92 and 0.95 ROC AUC scores in anomaly detection and motion mode prediction (e.g., sun-pointing, spin, tumbling). Analysis of high-confidence predictions on real data revealed distinct patterns including characteristic object profiles and satellite glinting. Our work demonstrates how self-supervised learning can simultaneously enable anomaly detection, motion prediction, and synthetic data generation from rich pre-trained representations, supporting space safety and sustainability through automated monitoring and simulation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 36 references that are in the map. First posted on arXiv 8 Apr 2025.

Builds on

10 of 36 references.

References · 10

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  4. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
  5. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  6. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  7. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
  8. 2023ClimaX: A foundation model for weather and climatecited by 337
  9. 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 248
  10. 2023Trustchain -- Trustworthy Decentralised Public Key Infrastructure for Digital Credentialscited by 1

Built on by

Not cited yet.