mlsanityData to 14 Oct 2026

KATANA: A Fast, Low-Power Mapping of Kalman Filters onto Edge NPUs for Real-Time Tracking

arXiv 2606.14992 ↗First posted 12 Jun 2026cs.AR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

State estimation is the closed-loop core of every real-time tracking system, from radar surveillance and counter-UAV defense to autonomous driving and robotics. These deployments run on edge platforms, where defense systems mount on vehicles and drones, and civilian pipelines live on cars and handheld devices. Here, every additional watt of compute erodes mission duration or operational range. Two hard constraints follow: each new measurement must be fused before the next control cycle, and the total compute must fit within a strict battery and thermal power envelope. The Linear and Extended Kalman Filters (LKF, EKF) are dominant estimators on these systems, but today they execute almost exclusively on CPUs, which serialize multi-object tracking (MOT) updates, or on custom FPGA/ASIC accelerators that lengthen design cycles. Contemporary AI-PC SoCs, like the Intel Core Ultra Series 1 and 2, integrate a low-power, data-parallel Neural Processing Unit (NPU). We therefore ask whether the Kalman filter can be mapped onto this existing matrix engine to meet real-time and low-power budgets simultaneously, avoiding a dedicated accelerator and keeping the CPU and GPU free for primary workloads. We present KATANA, an NPU-aware optimization framework delivering the first end-to-end mapping of the LKF and EKF onto a commercial NPU, alongside a cross-platform characterization on shipping AI-PC silicon. KATANA applies three algebraic graph rewrites: subtract-to-add reformulation via a precomputed negative-projection matrix H_neg, static-shape tensor fusion, and block-diagonal batched parallelization, ensuring 100% of operations execute on the DPU matrix engine. On the Series 2, the optimized batched EKF reaches 223.35 FPS at 13.43 W active power, and the LKF reaches 408.73 FPS at 14.05 W, delivering up to a 97.9% reduction in dynamic energy versus the CPU implementation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 14 references that are in the map. First posted on arXiv 12 Jun 2026.

Builds on

3 of 14 references.

References · 3

  1. 2024FlexNN: A Dataflow-aware Flexible Deep Learning Accelerator for Energy-Efficient Edge Devicescited by 9
  2. 2025XAMBA: Enabling Efficient State Space Models on Resource-Constrained Neural Processing Unitscited by 3
  3. 2025GraNNite: Enabling High-Performance Execution of Graph Neural Networks on Resource-Constrained Neural Processing Unitscited by 2

Built on by

Not cited yet.