Self-Supervised State Space Model for Real-Time Traffic Accident Prediction Using eKAN Networks
Not on the map. Why?
Abstract (arXiv)
Accurate prediction of traffic accidents across different times and regions is vital for public safety. However, existing methods face two key challenges: 1) Generalization: Current models rely heavily on manually constructed multi-view structures, like POI distributions and road network densities, which are labor-intensive and difficult to scale across cities. 2) Real-Time Performance: While some methods improve accuracy with complex architectures, they often incur high computational costs, limiting their real-time applicability. To address these challenges, we propose SSL-eKamba, an efficient self-supervised framework for traffic accident prediction. To enhance generalization, we design two self-supervised auxiliary tasks that adaptively improve traffic pattern representation through spatiotemporal discrepancy awareness. For real-time performance, we introduce eKamba, an efficient model that redesigns the Kolmogorov-Arnold Network (KAN) architecture. This involves using learnable univariate functions for input activation and applying a selective mechanism (Selective SSM) to capture multi-variate correlations, thereby improving computational efficiency. Extensive experiments on two real-world datasets demonstrate that SSL-eKamba consistently outperforms state-of-the-art baselines. This framework may also offer new insights for other spatiotemporal tasks. Our source code is publicly available at http://github.com/KevinT618/SSL-eKamba.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 65 references that are in the map. First posted on arXiv 9 Sep 2024.
Builds on
23 of 65 references.
References · 23
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
11 more
- 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 673
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2024KAN: Kolmogorov-Arnold Networkscited by 634
- 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 415
- 2015Skip-Thought Vectorscited by 321
- 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
- 2019Predicting Citywide Crowd Flows in Irregular Regions Using Multi-View Graph Convolutional Networkscited by 40
- 2019Multi-GCN: Graph Convolutional Networks for Multi-View Networks, with Applications to Global Povertycited by 19
- 2018Autowarp: Learning a Warping Distance from Unlabeled Time Series Using Sequence Autoencoderscited by 14
- 2022Traffic Accident Risk Forecasting using Contextual Vision Transformerscited by 4
Built on by
Not cited yet.