Vega: A 10-Core SoC for IoT End-Nodes with DNN Acceleration and Cognitive Wake-Up From MRAM-Based State-Retentive Sleep Mode
Not on the map. Why?
Abstract (arXiv)
The Internet-of-Things requires end-nodes with ultra-low-power always-on capability for a long battery lifetime, as well as high performance, energy efficiency, and extreme flexibility to deal with complex and fast-evolving near-sensor analytics algorithms (NSAAs). We present Vega, an IoT end-node SoC capable of scaling from a 1.7 μW fully retentive cognitive sleep mode up to 32.2 GOPS (@ 49.4 mW) peak performance on NSAAs, including mobile DNN inference, exploiting 1.6 MB of state-retentive SRAM, and 4 MB of non-volatile MRAM. To meet the performance and flexibility requirements of NSAAs, the SoC features 10 RISC-V cores: one core for SoC and IO management and a 9-cores cluster supporting multi-precision SIMD integer and floating-point computation. Vega achieves SoA-leading efficiency of 615 GOPS/W on 8-bit INT computation (boosted to 1.3TOPS/W for 8-bit DNN inference with hardware acceleration). On floating-point (FP) compuation, it achieves SoA-leading efficiency of 79 and 129 GFLOPS/W on 32- and 16-bit FP, respectively. Two programmable machine-learning (ML) accelerators boost energy efficiency in cognitive sleep and active states, respectively.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 6 of its 46 references that are in the map. First posted on arXiv 18 Oct 2021.
Builds on
6 of 46 references.
References · 6
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 666
- 2021RepVGG: Making VGG-style ConvNets Great Againcited by 520
- 2020DORY: Automatic End-to-End Deployment of Real-World DNNs on Low-Cost IoT MCUscited by 57
- 2016A near-threshold RISC-V core with DSP extensions for scalable IoT Endpoint Devicescited by 12
- 2020FPnew: An Open-Source Multi-Format Floating-Point Unit Architecture for Energy-Proportional Transprecision Computingcited by 7
Built on by
Citing papers per year: 2022: 3; 2023: 7; 2024: 4; 2025: 1; 2026: 1.
16 papers.
Sort:
- 2023A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platformscited by 21
- 2023Flexible and Fully Quantized Ultra-Lightweight TinyissimoYOLO for Ultra-Low-Power Edge Systemscited by 11
- 2023Reduced Precision Floating-Point Optimization for Deep Neural Network On-Device Learning on MicroControllerscited by 10
- 2023Marsellus: A Heterogeneous RISC-V AI-IoT End-Node SoC with 2-to-8b DNN Acceleration and 30%-Boost Adaptive Body Biasingcited by 8
- 2023RedMule: A Mixed-Precision Matrix-Matrix Operation Engine for Flexible and Energy-Efficient On-Chip Linear Algebra and TinyML Training Accelerationcited by 4
- 2024Boosting keyword spotting through on-device learnable user speech characteristicscited by 4
- 2024Multi-resolution Rescored ByteTrack for Video Object Detection on Ultra-low-power Embedded Systemscited by 4
- 2024Training on the Fly: On-device Self-supervised Learning aboard Nano-drones within 20 mWcited by 4
- 2023Parallelizing Optical Flow Estimation on an Ultra-Low Power RISC-V Cluster for Nano-UAV Navigationcited by 3
- 2022A Heterogeneous In-Memory Computing Cluster For Flexible End-to-End Inference of Real-World Deep Neural Networkscited by 2
- 2022An Ultra-low Power TinyML System for Real-time Visual Processing at Edgecited by 2
- 2025Lightweight Software Kernels and Hardware Extensions for Efficient Sparse Deep Neural Networks on Microcontrollerscited by 2
4 more
- 2023HiSSNet: Sound Event Detection and Speaker Identification via Hierarchical Prototypical Networks for Low-Resource Headphonescited by 1
- 2022Many-to-One Knowledge Distillation of Real-Time Epileptic Seizure Detection for Low-Power Wearable Internet of Things Systemscited by 0
- 2024Accelerating Depthwise Separable Convolutions on Ultra-Low-Power Devicescited by 0
- 2026MR2-ByteTrack: CNN and Transformer-based Video Object Detection for AI-augmented Embedded Vision Sensor Nodescited by 0
- 2026MR2-ByteTrack: CNN and Transformer-based Video Object Detection for AI-augmented Embedded Vision Sensor Nodes14 May 2026
- 2025Lightweight Software Kernels and Hardware Extensions for Efficient Sparse Deep Neural Networks on Microcontrollers8 Mar 2025
- 2024Training on the Fly: On-device Self-supervised Learning aboard Nano-drones within 20 mW6 Aug 2024
- 2024Accelerating Depthwise Separable Convolutions on Ultra-Low-Power Devices18 Jun 2024
- 2024Multi-resolution Rescored ByteTrack for Video Object Detection on Ultra-low-power Embedded Systems17 Apr 2024
- 2024Boosting keyword spotting through on-device learnable user speech characteristics12 Mar 2024
- 2023Flexible and Fully Quantized Ultra-Lightweight TinyissimoYOLO for Ultra-Low-Power Edge Systems12 Jul 2023
- 2023A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms27 Jun 2023
- 2023Reduced Precision Floating-Point Optimization for Deep Neural Network On-Device Learning on MicroControllers30 May 2023
- 2023Parallelizing Optical Flow Estimation on an Ultra-Low Power RISC-V Cluster for Nano-UAV Navigation22 May 2023
- 2023Marsellus: A Heterogeneous RISC-V AI-IoT End-Node SoC with 2-to-8b DNN Acceleration and 30%-Boost Adaptive Body Biasing15 May 2023
- 2023HiSSNet: Sound Event Detection and Speaker Identification via Hierarchical Prototypical Networks for Low-Resource Headphones13 Mar 2023
4 more
- 2023RedMule: A Mixed-Precision Matrix-Matrix Operation Engine for Flexible and Energy-Efficient On-Chip Linear Algebra and TinyML Training Acceleration10 Jan 2023
- 2022Many-to-One Knowledge Distillation of Real-Time Epileptic Seizure Detection for Low-Power Wearable Internet of Things Systems20 Jul 2022
- 2022An Ultra-low Power TinyML System for Real-time Visual Processing at Edge11 Jul 2022
- 2022A Heterogeneous In-Memory Computing Cluster For Flexible End-to-End Inference of Real-World Deep Neural Networks4 Jan 2022
- 2023A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platformscited by 21
- 2023Flexible and Fully Quantized Ultra-Lightweight TinyissimoYOLO for Ultra-Low-Power Edge Systemscited by 11
- 2023Reduced Precision Floating-Point Optimization for Deep Neural Network On-Device Learning on MicroControllerscited by 10
- 2023Marsellus: A Heterogeneous RISC-V AI-IoT End-Node SoC with 2-to-8b DNN Acceleration and 30%-Boost Adaptive Body Biasingcited by 8
- 2023RedMule: A Mixed-Precision Matrix-Matrix Operation Engine for Flexible and Energy-Efficient On-Chip Linear Algebra and TinyML Training Accelerationcited by 4
- 2024Boosting keyword spotting through on-device learnable user speech characteristicscited by 4
- 2024Multi-resolution Rescored ByteTrack for Video Object Detection on Ultra-low-power Embedded Systemscited by 4
- 2024Training on the Fly: On-device Self-supervised Learning aboard Nano-drones within 20 mWcited by 4
- 2023Parallelizing Optical Flow Estimation on an Ultra-Low Power RISC-V Cluster for Nano-UAV Navigationcited by 3
- 2022A Heterogeneous In-Memory Computing Cluster For Flexible End-to-End Inference of Real-World Deep Neural Networkscited by 2
- 2022An Ultra-low Power TinyML System for Real-time Visual Processing at Edgecited by 2
- 2025Lightweight Software Kernels and Hardware Extensions for Efficient Sparse Deep Neural Networks on Microcontrollerscited by 2
12 most cited of 16 All 16 (JSON)
- 2026MR2-ByteTrack: CNN and Transformer-based Video Object Detection for AI-augmented Embedded Vision Sensor Nodes14 May 2026
- 2025Lightweight Software Kernels and Hardware Extensions for Efficient Sparse Deep Neural Networks on Microcontrollers8 Mar 2025
- 2024Training on the Fly: On-device Self-supervised Learning aboard Nano-drones within 20 mW6 Aug 2024
- 2024Accelerating Depthwise Separable Convolutions on Ultra-Low-Power Devices18 Jun 2024
- 2024Multi-resolution Rescored ByteTrack for Video Object Detection on Ultra-low-power Embedded Systems17 Apr 2024
- 2024Boosting keyword spotting through on-device learnable user speech characteristics12 Mar 2024
- 2023Flexible and Fully Quantized Ultra-Lightweight TinyissimoYOLO for Ultra-Low-Power Edge Systems12 Jul 2023
- 2023A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms27 Jun 2023
- 2023Reduced Precision Floating-Point Optimization for Deep Neural Network On-Device Learning on MicroControllers30 May 2023
- 2023Parallelizing Optical Flow Estimation on an Ultra-Low Power RISC-V Cluster for Nano-UAV Navigation22 May 2023
- 2023Marsellus: A Heterogeneous RISC-V AI-IoT End-Node SoC with 2-to-8b DNN Acceleration and 30%-Boost Adaptive Body Biasing15 May 2023
- 2023HiSSNet: Sound Event Detection and Speaker Identification via Hierarchical Prototypical Networks for Low-Resource Headphones13 Mar 2023
12 newest of 16 All 16 (JSON)