mlsanityData to 14 Oct 2026

Hardware-Aware Neural Feature Extraction for Resource-Constrained Devices

arXiv 2605.04282 ↗First posted 5 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Visual SLAM is a core component of spatial computing systems, yet deploying learned local feature extractors on microcontroller-class hardware remains challenging due to memory, bandwidth, and quantization constraints. While modern neural descriptors provide strong robustness, their practical adoption is often hindered by system-level bottlenecks that are not captured by FLOP-based efficiency metrics. In this work, we introduce Gideon, a hardware-aware neural feature extractor explicitly designed for resource-constrained devices. Our approach combines relational knowledge distillation from a SuperPoint teacher with differentiable neural architecture search (DNAS) under strict memory and operator constraints. Unlike conventional design pipelines, we treat quantization stability and dynamic-range compactness as first-class objectives. We show that architectural choices such as replacing Batch Normalization with affine layers significantly improve INT8 robustness, and that descriptor dimensionality directly governs quantization resilience. Deployed on STM32N6, Gideon achieves 9.003 ms inference time (111 fps) while remaining below a 1.5 MB memory footprint. Remarkably, INT8 quantization induces negligible degradation and occasionally matches full-precision performance. These results demonstrate that robust learned feature extraction can be reconciled with embedded hardware constraints through holistic hardware-algorithm co-design.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

19 of 29 references.

References · 19

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  3. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  4. 2018DARTS: Differentiable Architecture Searchcited by 1,798
  5. 2014FitNets: Hints for Thin Deep Netscited by 1,653
  6. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
  7. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
  8. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
  9. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,148
  10. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
  11. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
  12. 2023LightGlue: Local Feature Matching at Light Speedcited by 590
7 more
  1. 2019Data-Free Quantization Through Weight Equalization and Bias Correctioncited by 336
  2. 2020DISK: Learning local features with policy gradientcited by 312
  3. 2017HPatches: A benchmark and evaluation of handcrafted and learned local descriptorscited by 264
  4. 2020Training with Quantization Noise for Extreme Model Compressioncited by 145
  5. 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 121
  6. 2018The TUM VI Benchmark for Evaluating Visual-Inertial Odometrycited by 99
  7. 2023NanoSLAM: Enabling Fully Onboard SLAM for Tiny Robotscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024A Neurosymbolic Approach to Adaptive Feature Extraction in SLAM
  2. 2026Quantized AI Inference on Constrained Embedded Platforms for Small-Satellite Settings
  3. 2023Design Space Exploration of Low-Bit Quantized Neural Networks for Visual Place Recognition
  4. 2024Query Quantized Neural SLAM
  5. 2024Exploring Quantization and Mapping Synergy in Hardware-Aware Deep Neural Network Accelerators
  6. 2025RAM-NAS: Resource-aware Multiobjective Neural Architecture Search Method for Robot Vision Tasks
  7. 2026EdgeVLN: Runtime-Aware Deployment Ready Quantized Vision Language Navigation Model
  8. 2022ZippyPoint: Fast Interest Point Detection, Description, and Matching through Mixed Precision Discretization