mlsanityData to 14 Oct 2026

PLEIADES: Building Temporal Kernels with Orthogonal Polynomials

arXiv 2405.12179 ↗First posted 20 May 2024cs.LG cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

We introduce a class of neural networks named PLEIADES (PoLynomial Expansion In Adaptive Distributed Event-based Systems), which contains temporal convolution kernels generated from orthogonal polynomial basis functions. We focus on interfacing these networks with event-based data to perform online spatiotemporal classification and detection with low latency. By virtue of using structured temporal kernels and event-based data, we have the freedom to vary the sample rate of the data along with the discretization step-size of the network without additional finetuning. We experimented with three event-based benchmarks and obtained state-of-the-art results on all three by large margins with significantly smaller memory and compute costs. We achieved: 1) 99.59% accuracy with 192K parameters on the DVS128 hand gesture recognition dataset and 100% with a small additional output filter; 2) 99.58% test accuracy with 277K parameters on the AIS 2024 eye tracking challenge; and 3) 0.556 mAP with 576k parameters on the PROPHESEE 1 Megapixel Automotive Detection Dataset.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 33 of its 45 references that are in the map. First posted on arXiv 20 May 2024.

Builds on

33 of 45 references.

References · 33

  1. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  4. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  5. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  6. 2019Objects as Pointscited by 1,175
  7. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
  8. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  9. 2019Event-based Vision: A Surveycited by 1,016
  10. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
  11. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
  12. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
21 more
  1. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 508
  2. 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 499
  3. 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 393
  4. 2017Learning Spatio-Temporal Representation with Pseudo-3D Residual Networkscited by 387
  5. 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 307
  6. 2018SLAYER: Spike Layer Error Reassignment in Timecited by 266
  7. 2019End-to-End Learning of Representations for Asynchronous Event-Based Datacited by 217
  8. 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 200
  9. 2016Temporal Convolutional Networks: A Unified Approach to Action Segmentationcited by 199
  10. 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
  11. 2019Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Camerascited by 170
  12. 2021CKConv: Continuous Kernel Convolution For Sequential Datacited by 120
  13. 2024State Space Models for Event Camerascited by 75
  14. 2023GET: Group Event Transformer for Event-Based Visioncited by 73
  15. 2023Simple Hardware-Efficient Long Convolutions for Sequence Modelingcited by 62
  16. 2017Gradient Descent for Spiking Neural Networkscited by 48
  17. 2022S4ND: Modeling Images and Videos as Multidimensional Signals Using State Spacescited by 41
  18. 2024Event-Based Eye Tracking. AIS 2024 Challenge Surveycited by 19
  19. 2024A Lightweight Spatiotemporal Network for Online Eye Tracking with Event Cameracited by 14
  20. 2022Neuromorphic Artificial Intelligence Systemscited by 12
  21. 2021Discrete Function Bases and Convolutional Neural Networkscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 1; 2026: 1.

4 papers.

  1. 2024STREAM: A Universal State-Space Model for Sparse Geometric Datacited by 2
  2. 2025Let SSMs be ConvNets: State-space Modeling with Optimal Tensor Contractionscited by 2
  3. 2024aTENNuate: Optimized Real-time Speech Enhancement with Deep SSMs on Raw Audiocited by 0
  4. 2026FATE: Pillar Encoding and Frequency-Aware Training for Event-Based Object Detectioncited by 0