# TinyML: Tools, Applications, Challenges, and Future Research Directions

arXiv: https://arxiv.org/abs/2303.13569 · HTML: https://mlsanity.com/paper/2303.13569/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- Builds on 25 of its 110 references that are in the map.
- First posted on arXiv 23 Mar 2023.

## Builds on (most cited first, 25 of 25)

- [AutoFlow: Learning a Better Training Set for Optical Flow](https://mlsanity.com/paper/2104.14544/) (2021)
- [Benchmarking TinyML Systems: Challenges and Direction](https://mlsanity.com/paper/2003.04821/) (2020)
- [TinyOL: TinyML with Online-Learning on Microcontrollers](https://mlsanity.com/paper/2103.08295/) (2021)
- [hls4ml: An Open-Source Codesign Workflow to Empower Scientific Low-Power Machine Learning Devices](https://mlsanity.com/paper/2103.05579/) (2021)
- [A Comprehensive Survey on Hardware-Aware Neural Architecture Search](https://mlsanity.com/paper/2101.09336/) (2021)
- [TinyLSTMs: Efficient Neural Speech Enhancement for Hearing Aids](https://mlsanity.com/paper/2005.11138/) (2020)
- [TinyTL: Reduce Activations, Not Trainable Parameters for Efficient On-Device Learning](https://mlsanity.com/paper/2007.11622/) (2020)
- [Tiny Transducer: A Highly-efficient Speech Recognition Model on Edge Devices](https://mlsanity.com/paper/2101.06856/) (2021)
- [FANN-on-MCU: An Open-Source Toolkit for Energy-Efficient Neural Network Inference at the Edge of the Internet of Things](https://mlsanity.com/paper/1911.03314/) (2019)
- [Widening Access to Applied Machine Learning with TinyML](https://mlsanity.com/paper/2106.04008/) (2021)
- [PhiNets: a scalable backbone for low-power AI at the edge](https://mlsanity.com/paper/2110.00337/) (2021)
- [Differentiable Network Pruning for Microcontrollers](https://mlsanity.com/paper/2110.08350/) (2021)
- [A Survey on Semantic Communications for Intelligent Wireless Networks](https://mlsanity.com/paper/2202.03705/) (2022)
- [Intelligence at the Extreme Edge: A Survey on Reformable TinyML](https://mlsanity.com/paper/2204.00827/) (2022)
- [Robustifying the Deployment of tinyML Models for Autonomous mini-vehicles](https://mlsanity.com/paper/2007.00302/) (2020)
- [A Tiny CNN Architecture for Medical Face Mask Detection for Resource-Constrained Endpoints](https://mlsanity.com/paper/2011.14858/) (2020)
- [On the quantization of recurrent neural networks](https://mlsanity.com/paper/2101.05453/) (2021)
- [Rethinking Generalization in American Sign Language Prediction for Edge Devices with Extremely Low Memory Footprint](https://mlsanity.com/paper/2011.13741/) (2020)
- [Toward Compact Deep Neural Networks via Energy-Aware Pruning](https://mlsanity.com/paper/2103.10858/) (2021)
- [A Distributed Deep Reinforcement Learning Technique for Application Placement in Edge and Fog Computing Environments](https://mlsanity.com/paper/2110.12415/) (2021)
- [DNN is not all you need: Parallelizing Non-Neural ML Algorithms on Ultra-Low-Power IoT Processors](https://mlsanity.com/paper/2107.09448/) (2021)
- [Massive Wireless Energy Transfer: Enabling Sustainable IoT Towards 6G Era](https://mlsanity.com/paper/1912.05322/) (2019)
- [White Paper on Critical and Massive Machine Type Communication Towards 6G](https://mlsanity.com/paper/2004.14146/) (2020)
- [Energy-Efficient Inference on the Edge Exploiting TinyML Capabilities for UAVs](https://mlsanity.com/paper/2111.15481/) (2021)
- [A Survey on Brain-Computer Interface and Related Applications](https://mlsanity.com/paper/2203.09164/) (2022)

## Built on by (most cited first, 14 of 14)

- [Large Language Models Empowered Autonomous Edge AI for Connected Intelligence](https://mlsanity.com/paper/2307.02779/) (2023)
- [On TinyML and Cybersecurity: Electric Vehicle Charging Infrastructure Use Case](https://mlsanity.com/paper/2404.16894/) (2024)
- [From Tiny Machine Learning to Tiny Deep Learning: A Survey](https://mlsanity.com/paper/2506.18927/) (2025)
- [TinyML Security: Exploring Vulnerabilities in Resource-Constrained Machine Learning Systems](https://mlsanity.com/paper/2411.07114/) (2024)
- [Towards Scalable Insect Monitoring: Ultra-Lightweight CNNs as On-Device Triggers for Insect Camera Traps](https://mlsanity.com/paper/2411.14467/) (2024)
- [Hardware/Software Co-Design of RISC-V Extensions for Accelerating Sparse DNNs on FPGAs](https://mlsanity.com/paper/2504.19659/) (2025)
- [TinyFormer: Efficient Transformer Design and Deployment on Tiny Devices](https://mlsanity.com/paper/2311.01759/) (2023)
- [TinyML for Speech Recognition](https://mlsanity.com/paper/2504.16213/) (2025)
- [Towards Contactless Elevators with TinyML using CNN-based Person Detection and Keyword Spotting](https://mlsanity.com/paper/2405.13051/) (2024)
- [Semantic Meta-Split Learning: A TinyML Scheme for Few-Shot Wireless Image Classification](https://mlsanity.com/paper/2409.12978/) (2024)
- [Neural Network-Based Bandit: A Medium Access Control for the IIoT Alarm Scenario](https://mlsanity.com/paper/2407.16877/) (2024)
- [On-Device Continual Learning for Unsupervised Visual Anomaly Detection in Dynamic Manufacturing](https://mlsanity.com/paper/2512.13497/) (2025)
- [Navigating Ethical AI Challenges in the Industrial Sector: Balancing Innovation and Responsibility](https://mlsanity.com/paper/2601.09351/) (2026)
- [Human-Centered Explainable AI for TinyML Edge Devices: A Pareto-Based Selection Framework with LLM-Guided Design](https://mlsanity.com/paper/2608.07091/) (2026)

## Abstract (arXiv)

In recent years, Artificial Intelligence (AI) and Machine learning (ML) have gained significant interest from both, industry and academia. Notably, conventional ML techniques require enormous amounts of power to meet the desired accuracy, which has limited their use mainly to high-capability devices such as network nodes. However, with many advancements in technologies such as the Internet of Things (IoT) and edge computing, it is desirable to incorporate ML techniques into resource-constrained embedded devices for distributed and ubiquitous intelligence. This has motivated the emergence of the TinyML paradigm which is an embedded ML technique that enables ML applications on multiple cheap, resource- and power-constrained devices. However, during this transition towards appropriate implementation of the TinyML technology, multiple challenges such as processing capacity optimization, improved reliability, and maintenance of learning models' accuracy require timely solutions. In this article, various avenues available for TinyML implementation are reviewed. Firstly, a background of TinyML is provided, followed by detailed discussions on various tools supporting TinyML. Then, state-of-art applications of TinyML using advanced technologies are detailed. Lastly, various research challenges and future directions are identified.