Quantized AI Inference on Constrained Embedded Platforms for Small-Satellite Settings
Not on the map. Why?
Abstract (arXiv)
In resource-constrained small-satellite settings, AI inference must operate under tight size, power, and payload budgets, which tend to limit onboard compute capability and data handling. These conditions motivate establishing a clear baseline for quantized AI inference under bounded compute and memory resources. To instantiate this baseline, a representative embedded-vision neural-network workload serves as the reference case. With this motivation, this paper presents a measurement-based characterization of quantized execution for this AI workload on highly constrained embedded platforms (for instance, Cortex-M), grounded as a lower-bound operating point. In this regime, scaling tends to rely on explicit orchestration rather than OS-managed, transparent multicore scheduling, and timing behavior is shaped by instruction efficiency and memory movement. As a result, the characterization provides a structured reference for estimating execution time across orchestrated configurations (e.g., multiple cores and/or devices), treating orchestration and architectural variation as explicit design choices. We report latency metrics alongside data-movement observations, and interpret these measurements in light of ALU/SIMD utilization under quantized arithmetic for the Cortex-M. Finally, we outline how this baseline provides a reference point for positioning the results against more space-typical embedded processor classes (e.g., LEON/NOEL-V).
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 14 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
4 of 14 references.
References · 4
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
- 2020TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systemscited by 165
- 2018CMSIS-NN: Efficient Neural Network Kernels for Arm Cortex-M CPUscited by 121
- 2025Achieving Dependability of AI Execution with Radiation Hardened Processorscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ALADIN: Accuracy-Latency-Aware Design-space Inference Analysis for Embedded AI Accelerators
- 2026Memory-Bound but Not Bandwidth-Limited: The Physical AI Inference Gap in Batch-1 LLM Decode
- 2026From LLM to Silicon: RL-Driven ASIC Architecture Exploration for On-Device AI Inference
- 2026Evaluating Inference Compute for Generative AI: A Framework for Enterprise Workloads
- 2025Evaluating the Energy Efficiency of NPU-Accelerated Machine Learning Inference on Embedded Microcontrollers
- 2026SMEPilot: Characterizing and Optimizing LLM Inference with Scalable Matrix Extensions
- 2026Is INT8 Portable? A Cross-Platform Measurement Study of Quantized Inference on Embedded and Automotive Accelerators
- 2025Characterizing Mobile SoC for Accelerating Heterogeneous LLM Inference