Continual Inference: A Library for Efficient Online Inference with Deep Neural Networks in PyTorch
Not on the map. Why?
Abstract (arXiv)
We present Continual Inference, a Python library for implementing Continual Inference Networks (CINs) in PyTorch, a class of Neural Networks designed specifically for efficient inference in both online and batch processing scenarios. We offer a comprehensive introduction and guide to CINs and their implementation in practice, and provide best-practices and code examples for composing complex modules for modern Deep Learning. Continual Inference is readily downloadable via the Python Package Index and at urlwww.github.com/lukashedegaard/continual-inference.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 14 of its 21 references that are in the map. First posted on arXiv 7 Apr 2022.
Builds on
14 of 21 references.
References · 14
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Going Deeper with Convolutionscited by 4,231
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2018SlowFast Networks for Video Recognitioncited by 1,862
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 635
- 2020Skeleton-based Action Recognition via Spatial and Temporal Transformer Networkscited by 98
- 2015Beyond Temporal Pooling: Recurrence and Temporal Convolutions for Gesture Recognition in Videocited by 15
- 2022Continual Transformers: Redundancy-Free Attention for Online Inferencecited by 12
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 1; 2025: 5.
8 papers.
- 2022Efficient High-Resolution Deep Learning: A Surveycited by 9
- 2025Real-Time Streamable Generative Speech Restoration with Flow Matchingcited by 4
- 2024Continual Low-Rank Scaled Dot-product Attentioncited by 2
- 2025LOBERT: Generative AI Foundation Model for Limit Order Book Messagescited by 2
- 2025Online hand gesture recognition using Continual Graph Transformerscited by 1
- 2025Real-Time Streaming Mel Vocoding with Generative Flow Matchingcited by 1
- 2023Efficient Online Processing with Deep Neural Networkscited by 0
- 2025DeepCoT: Deep Continual Transformers for Real-Time Inference on Data Streamscited by 0
- 2025Real-Time Streamable Generative Speech Restoration with Flow Matching22 Dec 2025
- 2025DeepCoT: Deep Continual Transformers for Real-Time Inference on Data Streams21 Nov 2025
- 2025LOBERT: Generative AI Foundation Model for Limit Order Book Messages16 Nov 2025
- 2025Real-Time Streaming Mel Vocoding with Generative Flow Matching18 Sep 2025
- 2025Online hand gesture recognition using Continual Graph Transformers20 Feb 2025
- 2024Continual Low-Rank Scaled Dot-product Attention4 Dec 2024
- 2023Efficient Online Processing with Deep Neural Networks23 Jun 2023
- 2022Efficient High-Resolution Deep Learning: A Survey26 Jul 2022