Visual Wake Words Dataset
Not on the map. Why?
Abstract (arXiv)
The emergence of Internet of Things (IoT) applications requires intelligence on the edge. Microcontrollers provide a low-cost compute platform to deploy intelligent IoT applications using machine learning at scale, but have extremely limited on-chip memory and compute capability. To deploy computer vision on such devices, we need tiny vision models that fit within a few hundred kilobytes of memory footprint in terms of peak usage and model size on device storage. To facilitate the development of microcontroller friendly models, we present a new dataset, Visual Wake Words, that represents a common microcontroller vision use-case of identifying whether a person is present in the image or not, and provides a realistic benchmark for tiny vision models. Within a limited memory footprint of 250 KB, several state-of-the-art mobile models achieve accuracy of 85-90% on the Visual Wake Words dataset. We anticipate the proposed dataset will advance the research on tiny vision models that can push the pareto-optimal boundary in terms of accuracy versus memory usage for microcontroller applications.
Key facts. Cited by 46 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 14; 2023: 4; 2024: 8; 2025: 5; 2026: 6.
46 papers.
Sort:
By area:
- 2022On-Device Training Under 256KB Memorycited by 160
- 2021MLPerf Tiny Benchmarkcited by 124
- 2021MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learningcited by 89
- 2022Machine Learning for Microcontroller-Class Hardware: A Reviewcited by 28
- 2022Edge Impulse: An MLOps Platform for Tiny Machine Learningcited by 24
- 2021Widening Access to Applied Machine Learning with TinyMLcited by 17
- 2021Differentiable Network Pruning for Microcontrollerscited by 16
- 2022P2M: A Processing-in-Pixel-in-Memory Paradigm for Resource-Constrained TinyML Applicationscited by 16
- 2021On-device Federated Learning with Flowercited by 13
- 2022Intelligence at the Extreme Edge: A Survey on Reformable TinyMLcited by 13
- 2021Quantization-Guided Training for Compact TinyML Modelscited by 10
- 2023AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computingcited by 10
34 more
- 2024On TinyML and Cybersecurity: Electric Vehicle Charging Infrastructure Use Casecited by 9
- 2021AnalogNets: ML-HW Co-Design of Noise-robust TinyML Models and Always-On Analog Compute-in-Memory Acceleratorcited by 7
- 2023Enhancing Neural Architecture Search with Multiple Hardware Constraints for Deep Learning Model Deployment on Tiny IoT Devicescited by 7
- 2021TinyFedTL: Federated Transfer Learning on Tiny Devicescited by 6
- 2022Accelerating Deep Learning Model Inference on Arm CPUs with Ultra-Low Bit Quantization and Runtimecited by 6
- 2023Towards On-device Learning on the Edge: Ways to Select Neurons to Update under a Budget Constraintcited by 6
- 2022Machine Learning Sensorscited by 5
- 2022T-RECX: Tiny-Resource Efficient Convolutional neural networks with early-eXitcited by 5
- 2024LLS: Local Learning Rule for Deep Neural Networks Inspired by Neural Activity Synchronizationcited by 5
- 2024TinySV: Speaker Verification in TinyML with On-device Learningcited by 5
- 2024On-Device Training of Fully Quantized Deep Neural Networks on Cortex-M Microcontrollerscited by 5
- 2024Mixed-precision Neural Networks on RISC-V Cores: ISA extensions for Multi-Pumped Soft SIMD Operationscited by 5
- 2021TENT: Efficient Quantization of Neural Networks on the tiny Edge with Tapered FixEd PoiNTcited by 4
- 2022Toward Efficient Hyperspectral Image Processing inside Camera Pixelscited by 4
- 2022Depth Pruning with Auxiliary Networks for TinyMLcited by 4
- 2024DTMM: Deploying TinyML Models on Extremely Weak IoT Devices with Pruningcited by 4
- 2022Pex: Memory-efficient Microcontroller Deep Learning through Partial Executioncited by 3
- 2024MicroFlow: An Efficient Rust-Based Inference Engine for TinyMLcited by 3
- 2025Hardware/Software Co-Design of RISC-V Extensions for Accelerating Sparse DNNs on FPGAscited by 3
- 2022Improving the Energy Efficiency and Robustness of tinyML Computer Vision using Log-Gradient Input Imagescited by 2
- 2025Searching Neural Architectures for Sensor Nodes on IoT Gatewayscited by 2
- 2026An affordable hardware-aware neural architecture search for deploying convolutional neural networks on ultra-low-power computing platformscited by 2
- 2022Hardware-aware mobile building block evaluation for computer visioncited by 1
- 2022Enabling ISP-less Low-Power Computer Visioncited by 1
- 2023Datasheets for Machine Learning Sensorscited by 1
- 2024Wake Vision: A Tailored Dataset and Benchmark Suite for TinyML Computer Vision Applicationscited by 1
- 2026BitFair: A 12-nm Bit-Serial CNN Accelerator with Learnable Early Termination and Adaptive Bit Ordering for Ultra-Low-Power XR Visioncited by 1
- 2025End-to-end fully-binarized network design: from Generic Learned Thermometer to Block Pruningcited by 0
- 2025Neural Network Acceleration on MPSoC board: Integrating SLAC's SNL, Rogue Software and Auto-SNLcited by 0
- 2025MaRVIn: A Cross-Layer Mixed-Precision RISC-V Framework for DNN Inference, from ISA Extension to Hardware Accelerationcited by 0
- 2026LUT-KAN: Segment-wise LUT Quantization for Fast KAN Inferencecited by 0
- 2026What changes after deployment? A survey on On-device Learning in TinyMLcited by 0
- 2026Low-Power License Plate Detection and Recognition on a RISC-V Multi-Core MCU-Based Vision Systemcited by 0
- 2026Hardware-Aware Learned Representation Compression for Distributed In-Sensor Visioncited by 0
- 2026Hardware-Aware Learned Representation Compression for Distributed In-Sensor Vision12 Sep 2026
- 2026Low-Power License Plate Detection and Recognition on a RISC-V Multi-Core MCU-Based Vision System7 Jul 2026
- 2026BitFair: A 12-nm Bit-Serial CNN Accelerator with Learnable Early Termination and Adaptive Bit Ordering for Ultra-Low-Power XR Vision4 Jul 2026
- 2026An affordable hardware-aware neural architecture search for deploying convolutional neural networks on ultra-low-power computing platforms15 Jun 2026
- 2026What changes after deployment? A survey on On-device Learning in TinyML29 May 2026
- 2026LUT-KAN: Segment-wise LUT Quantization for Fast KAN Inference6 Jan 2026
- 2025MaRVIn: A Cross-Layer Mixed-Precision RISC-V Framework for DNN Inference, from ISA Extension to Hardware Acceleration18 Sep 2025
- 2025Neural Network Acceleration on MPSoC board: Integrating SLAC's SNL, Rogue Software and Auto-SNL29 Aug 2025
- 2025Searching Neural Architectures for Sensor Nodes on IoT Gateways29 May 2025
- 2025End-to-end fully-binarized network design: from Generic Learned Thermometer to Block Pruning5 May 2025
- 2025Hardware/Software Co-Design of RISC-V Extensions for Accelerating Sparse DNNs on FPGAs28 Apr 2025
- 2024MicroFlow: An Efficient Rust-Based Inference Engine for TinyML28 Sep 2024
34 more
- 2024Mixed-precision Neural Networks on RISC-V Cores: ISA extensions for Multi-Pumped Soft SIMD Operations19 Jul 2024
- 2024On-Device Training of Fully Quantized Deep Neural Networks on Cortex-M Microcontrollers15 Jul 2024
- 2024TinySV: Speaker Verification in TinyML with On-device Learning3 Jun 2024
- 2024LLS: Local Learning Rule for Deep Neural Networks Inspired by Neural Activity Synchronization24 May 2024
- 2024Wake Vision: A Tailored Dataset and Benchmark Suite for TinyML Computer Vision Applications1 May 2024
- 2024On TinyML and Cybersecurity: Electric Vehicle Charging Infrastructure Use Case25 Apr 2024
- 2024DTMM: Deploying TinyML Models on Extremely Weak IoT Devices with Pruning17 Jan 2024
- 2023Towards On-device Learning on the Edge: Ways to Select Neurons to Update under a Budget Constraint8 Dec 2023
- 2023Enhancing Neural Architecture Search with Multiple Hardware Constraints for Deep Learning Model Deployment on Tiny IoT Devices11 Oct 2023
- 2023Datasheets for Machine Learning Sensors15 Jun 2023
- 2023AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computing17 May 2023
- 2022Pex: Memory-efficient Microcontroller Deep Learning through Partial Execution30 Nov 2022
- 2022Edge Impulse: An MLOps Platform for Tiny Machine Learning2 Nov 2022
- 2022Enabling ISP-less Low-Power Computer Vision11 Oct 2022
- 2022Hardware-aware mobile building block evaluation for computer vision26 Aug 2022
- 2022Accelerating Deep Learning Model Inference on Arm CPUs with Ultra-Low Bit Quantization and Runtime18 Jul 2022
- 2022T-RECX: Tiny-Resource Efficient Convolutional neural networks with early-eXit14 Jul 2022
- 2022On-Device Training Under 256KB Memory30 Jun 2022
- 2022Machine Learning Sensors7 Jun 2022
- 2022Machine Learning for Microcontroller-Class Hardware: A Review29 May 2022
- 2022Depth Pruning with Auxiliary Networks for TinyML22 Apr 2022
- 2022Intelligence at the Extreme Edge: A Survey on Reformable TinyML2 Apr 2022
- 2022Toward Efficient Hyperspectral Image Processing inside Camera Pixels11 Mar 2022
- 2022P2M: A Processing-in-Pixel-in-Memory Paradigm for Resource-Constrained TinyML Applications7 Mar 2022
- 2022Improving the Energy Efficiency and Robustness of tinyML Computer Vision using Log-Gradient Input Images4 Mar 2022
- 2021AnalogNets: ML-HW Co-Design of Noise-robust TinyML Models and Always-On Analog Compute-in-Memory Accelerator10 Nov 2021
- 2021MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning28 Oct 2021
- 2021Differentiable Network Pruning for Microcontrollers15 Oct 2021
- 2021TinyFedTL: Federated Transfer Learning on Tiny Devices3 Oct 2021
- 2021MLPerf Tiny Benchmark14 Jun 2021
- 2021Widening Access to Applied Machine Learning with TinyML7 Jun 2021
- 2021On-device Federated Learning with Flower7 Apr 2021
- 2021TENT: Efficient Quantization of Neural Networks on the tiny Edge with Tapered FixEd PoiNT6 Apr 2021
- 2021Quantization-Guided Training for Compact TinyML Models10 Mar 2021
- 2022On-Device Training Under 256KB Memorycited by 160
- 2021MLPerf Tiny Benchmarkcited by 124
- 2021MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learningcited by 89
- 2022Machine Learning for Microcontroller-Class Hardware: A Reviewcited by 28
- 2022Edge Impulse: An MLOps Platform for Tiny Machine Learningcited by 24
- 2021Widening Access to Applied Machine Learning with TinyMLcited by 17
- 2021Differentiable Network Pruning for Microcontrollerscited by 16
- 2022P2M: A Processing-in-Pixel-in-Memory Paradigm for Resource-Constrained TinyML Applicationscited by 16
- 2021On-device Federated Learning with Flowercited by 13
- 2022Intelligence at the Extreme Edge: A Survey on Reformable TinyMLcited by 13
- 2021Quantization-Guided Training for Compact TinyML Modelscited by 10
- 2023AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computingcited by 10
12 most cited of 45 All 45 (JSON)
- 2026Hardware-Aware Learned Representation Compression for Distributed In-Sensor Vision12 Sep 2026
- 2026Low-Power License Plate Detection and Recognition on a RISC-V Multi-Core MCU-Based Vision System7 Jul 2026
- 2026BitFair: A 12-nm Bit-Serial CNN Accelerator with Learnable Early Termination and Adaptive Bit Ordering for Ultra-Low-Power XR Vision4 Jul 2026
- 2026An affordable hardware-aware neural architecture search for deploying convolutional neural networks on ultra-low-power computing platforms15 Jun 2026
- 2026What changes after deployment? A survey on On-device Learning in TinyML29 May 2026
- 2026LUT-KAN: Segment-wise LUT Quantization for Fast KAN Inference6 Jan 2026
- 2025MaRVIn: A Cross-Layer Mixed-Precision RISC-V Framework for DNN Inference, from ISA Extension to Hardware Acceleration18 Sep 2025
- 2025Neural Network Acceleration on MPSoC board: Integrating SLAC's SNL, Rogue Software and Auto-SNL29 Aug 2025
- 2025Searching Neural Architectures for Sensor Nodes on IoT Gateways29 May 2025
- 2025End-to-end fully-binarized network design: from Generic Learned Thermometer to Block Pruning5 May 2025
- 2025Hardware/Software Co-Design of RISC-V Extensions for Accelerating Sparse DNNs on FPGAs28 Apr 2025
- 2024MicroFlow: An Efficient Rust-Based Inference Engine for TinyML28 Sep 2024
12 newest of 45 All 45 (JSON)