Compiler Toolchains for Deep Learning Workloads on Embedded Platforms
Not on the map. Why?
Abstract (arXiv)
As the usage of deep learning becomes increasingly popular in mobile and embedded solutions, it is necessary to convert the framework-specific network representations into executable code for these embedded platforms. This paper consists of two parts: The first section is made up of a survey and benchmark of the available open source deep learning compiler toolchains, which focus on the capabilities and performance of the individual solutions in regard to targeting embedded devices and microcontrollers that are combined with a dedicated accelerator in a heterogeneous fashion. The second part explores the implementation and evaluation of a compilation flow for such a heterogeneous device and reuses one of the existing toolchains to demonstrate the necessary steps for hardware developers that plan to build a software flow for their own hardware.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 51 references that are in the map. First posted on arXiv 8 Mar 2021.
Builds on
19 of 51 references.
References · 19
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2020What is the State of Neural Network Pruning?cited by 578
- 2018Quantizing deep convolutional networks for efficient inference: A whitepapercited by 507
- 2014cuDNN: Efficient Primitives for Deep Learningcited by 240
- 2019Structured Pruning of Large Language Modelscited by 201
- 2015MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systemscited by 195
- 2015Fixed Point Quantization of Deep Convolutional Networkscited by 141
- 2018CMSIS-NN: Efficient Neural Network Kernels for Arm Cortex-M CPUscited by 116
- 2019And the Bit Goes Down: Revisiting the Quantization of Neural Networkscited by 78
7 more
- 2018Glow: Graph Lowering Compiler Techniques for Neural Networkscited by 73
- 2020The Deep Learning Compiler: A Comprehensive Surveycited by 46
- 2019PULP-NN: Accelerating Quantized Neural Networks on Parallel Ultra-Low-Power RISC-V Processorscited by 34
- 2019FPGA-based Accelerators of Deep Learning Networks for Learning and Classification: A Reviewcited by 29
- 2018Toolflows for Mapping Convolutional Neural Networks on FPGAs: A Survey and Future Directionscited by 27
- 2018Intel nGraph: An Intermediate Representation, Compiler, and Executor for Deep Learningcited by 22
- 2019MIOpen: An Open Source Library For Deep Learning Primitivescited by 7
Built on by
Citing papers per year: 2023: 1.
1 paper.