mlsanityData to 7 Oct 2026

Early Exiting Predictive Coding Neural Networks for Edge AI

arXiv 2309.02022 ↗First posted 5 Sep 2023cs.LG cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The Internet of Things is transforming various fields, with sensors increasingly embedded in wearables, smart buildings, and connected equipment. While deep learning enables valuable insights from IoT data, conventional models are too computationally demanding for resource-limited edge devices. Moreover, privacy concerns and real-time processing needs make local computation a necessity over cloud-based solutions. Inspired by the brain's energy efficiency, we propose a shallow bidirectional predictive coding network with early exiting, dynamically halting computations once a performance threshold is met. This reduces the memory footprint and computational overhead while maintaining high accuracy. We validate our approach using the CIFAR-10 dataset. Our model achieves performance comparable to deep networks with significantly fewer parameters and lower computational complexity, demonstrating the potential of biologically inspired architectures for efficient edge AI.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 26 references that are in the map. First posted on arXiv 5 Sep 2023.

Builds on

12 of 26 references.

References · 12

  1. 2021Dynamic Neural Networks: A Surveycited by 405
  2. 2016Deep Predictive Coding Networks for Video Prediction and Unsupervised Learningcited by 203
  3. 2021MLPerf Tiny Benchmarkcited by 118
  4. 2019Machine Learning at the Network Edge: A Surveycited by 83
  5. 2021Adaptive Inference through Early-Exit Networks: Design, Challenges and Directionscited by 74
  6. 2019Improved Techniques for Training Adaptive Deep Networkscited by 66
  7. 2021Zero Time Waste: Recycling Predictions in Early Exit Neural Networkscited by 39
  8. 2018Deep Predictive Coding Network with Local Recurrent Processing for Object Recognitioncited by 25
  9. 2018Deep Predictive Coding Network for Object Recognitioncited by 23
  10. 2020Going in circles is the way forward: the role of recurrence in visual inferencecited by 19
  11. 2021Predify: Augmenting deep neural networks with brain-inspired predictive coding dynamicscited by 19
  12. 2020Weight Update Skipping: Reducing Training Time for Artificial Neural Networkscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Resource-Constrained Edge AI with Early Exit Prediction
  2. 2026A Comparative Study of CNN Optimization Methods for Edge AI: Exploring the Role of Early Exits
  3. 2023Sustainable Edge Intelligence Through Energy-Aware Early Exiting
  4. 2022Predictive Exit: Prediction of Fine-Grained Early Exits for Computation- and Energy-Efficient Inference
  5. 2025Cognitive Edge Computing: A Comprehensive Survey on Optimizing Large Models and AI Agents for Pervasive Deployment
  6. 2022An Adaptive Device-Edge Co-Inference Framework Based on Soft Actor-Critic
  7. 2022Fluid Batching: Exit-Aware Preemptive Serving of Early-Exit Neural Networks on Edge NPUs
  8. 2026SPARQ: Spiking Early-Exit Neural Networks for Energy-Efficient Edge AI