NeuCODEX: Edge-Cloud Co-Inference with Spike-Driven Compression and Dynamic Early-Exit
On the map: Efficient LLM inference and serving → Early exit and edge inference
Abstract (arXiv)
Spiking Neural Networks (SNNs) offer significant potential for enabling energy-efficient intelligence at the edge. However, performing full SNN inference at the edge can be challenging due to the latency and energy constraints arising from fixed and high timestep overheads. Edge-cloud co-inference systems present a promising solution, but their deployment is often hindered by high latency and feature transmission costs. To address these issues, we introduce NeuCODEX, a neuromorphic co-inference architecture that jointly optimizes both spatial and temporal redundancy. NeuCODEX incorporates a learned spike-driven compression module to reduce data transmission and employs a dynamic early-exit mechanism to adaptively terminate inference based on output confidence. We evaluated NeuCODEX on both static images (CIFAR10 and Caltech) and neuromorphic event streams (CIFAR10-DVS and N-Caltech). To demonstrate practicality, we prototyped NeuCODEX on ResNet-18 and VGG-16 backbones in a real edge-to-cloud testbed. Our proposed system reduces data transfer by up to 2048x and edge energy consumption by over 90%, while reducing end-to-end latency by up to 3x compared to edge-only inference, all with a negligible accuracy drop of less than 2%. In doing so, NeuCODEX enables practical, high-performance SNN deployment in resource-constrained environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Early exit and edge inference, one of 12 directions in Efficient LLM inference and serving. Builds on 11 of its 16 references that are in the map. First posted on arXiv 23 Sep 2025.
Builds on
11 of 16 references.
References · 11
- 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
- 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 345
- 2021Efficient Neuromorphic Signal Processing with Loihi 2cited by 96
- 2019BottleNet++: An End-to-End Approach for Feature Compression in Device-Edge Co-Inference Systemscited by 95
- 2023SEENN: Towards Temporal Spiking Early-Exit Neural Networkscited by 41
- 2024Shrinking Your TimeStep: Towards Low-Latency Neuromorphic Object Recognition with Spiking Neural Networkcited by 19
- 2023Unleashing the Potential of Spiking Neural Networks by Dynamic Confidencecited by 15
- 2023Spiking Neural Networks with Dynamic Time Steps for Vision Transformerscited by 3
- 2024SpikeBottleNet: Spike-Driven Feature Compression Architecture for Edge-Cloud Co-Inferencecited by 3
- 2023Spiking Semantic Communication for Feature Transmission with HARQcited by 2
- 2022SNN-SC: A Spiking Semantic Communication Framework for Collaborative Intelligencecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Brain-inspired AI for Edge Intelligence: a systematic review
- 2026L-SPINE: A Low-Precision SIMD Spiking Neural Compute Engine for Resource-efficient Edge Inference
- 2025Enabling Efficient Processing of Spiking Neural Networks with On-Chip Learning on Commodity Neuromorphic Processors for Edge AI Systems
- 2026CANS: Accelerating Multiuser Collaborative Edge Inference via Cooperative Autodidactic NeuroSurgeon
- 2025SpikeFit: Towards Optimal Deployment of Spiking Networks on Neuromorphic Hardware
- 2021A Spiking Neural Network for Image Segmentation
- 2026ELSA: An ELastic SNN Inference Architecture for Efficient Neuromorphic Computing
- 2021A Competitive Edge: Can FPGAs Beat GPUs at DCNN Inference Acceleration in Resource-Limited Edge Computing Applications?