# Temporal Patience: Efficient Adaptive Deep Learning for Embedded Radar Data Processing

arXiv: https://arxiv.org/abs/2309.05686 · HTML: https://mlsanity.com/paper/2309.05686/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 28 references that are in the map.
- First posted on arXiv 11 Sep 2023.

## Builds on (most cited first, 12 of 12)

- [Xception: Deep Learning with Depthwise Separable Convolutions](https://mlsanity.com/paper/1610.02357/) (2016)
- [Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images](https://mlsanity.com/paper/1412.1897/) (2014)
- [BERT Loses Patience: Fast and Robust Inference with Early Exit](https://mlsanity.com/paper/2006.04152/) (2020)
- [TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systems](https://mlsanity.com/paper/2010.08678/) (2020)
- [Adaptive Neural Networks for Efficient Inference](https://mlsanity.com/paper/1702.07811/) (2017)
- [Conditional Deep Learning for Energy-Efficient and Enhanced Pattern Recognition](https://mlsanity.com/paper/1509.08971/) (2015)
- [A Panda? No, It's a Sloth: Slowdown Attacks on Adaptive Multi-Exit Neural Network Inference](https://mlsanity.com/paper/2010.02432/) (2020)
- [Changing Model Behavior at Test-Time Using Reinforcement Learning](https://mlsanity.com/paper/1702.07780/) (2017)
- [TinyRadarNN: Combining Spatial and Temporal Convolutional Neural Networks for Embedded Gesture Recognition with Short Range Radars](https://mlsanity.com/paper/2006.16281/) (2020)
- [Label-Aware Ranked Loss for robust People Counting using Automotive in-cabin Radar](https://mlsanity.com/paper/2110.05876/) (2021)
- [Impatient DNNs - Deep Neural Networks with Dynamic Time Budgets](https://mlsanity.com/paper/1610.02850/) (2016)
- [Uncertainty-based Meta-Reinforcement Learning for Robust Radar Tracking](https://mlsanity.com/paper/2210.14532/) (2022)

## Built on by (most cited first, 2 of 2)

- [Temporal Decisions: Leveraging Temporal Correlation for Efficient Decisions in Early Exit Neural Networks](https://mlsanity.com/paper/2403.07958/) (2024)
- [Metacognitive Selective Ensemble for Mobile Systems](https://mlsanity.com/paper/2609.31031/) (2026)

## Abstract (arXiv)

Radar sensors offer power-efficient solutions for always-on smart devices, but processing the data streams on resource-constrained embedded platforms remains challenging. This paper presents novel techniques that leverage the temporal correlation present in streaming radar data to enhance the efficiency of Early Exit Neural Networks for Deep Learning inference on embedded devices. These networks add additional classifier branches between the architecture's hidden layers that allow for an early termination of the inference if their result is deemed sufficient enough by an at-runtime decision mechanism. Our methods enable more informed decisions on when to terminate the inference, reducing computational costs while maintaining a minimal loss of accuracy. Our results demonstrate that our techniques save up to 26% of operations per inference over a Single Exit Network and 12% over a confidence-based Early Exit version. Our proposed techniques work on commodity hardware and can be combined with traditional optimizations, making them accessible for resource-constrained embedded platforms commonly used in smart devices. Such efficiency gains enable real-time radar data processing on resource-constrained platforms, allowing for new applications in the context of smart homes, Internet-of-Things, and human-computer interaction.
