mlsanityData to 7 Oct 2026

ConvXformer: Differentially Private Hybrid ConvNeXt-Transformer for Inertial Navigation

arXiv 2510.19352 ↗First posted 22 Oct 2025cs.LG cs.CR cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Data-driven inertial sequence learning has revolutionized navigation in GPS-denied environments, offering superior odometric resolution compared to traditional Bayesian methods. However, deep learning-based inertial tracking systems remain vulnerable to privacy breaches that can expose sensitive training data. hlExisting differential privacy solutions often compromise model performance by introducing excessive noise, particularly in high-frequency inertial measurements. In this article, we propose ConvXformer, a hybrid architecture that fuses ConvNeXt blocks with Transformer encoders in a hierarchical structure for robust inertial navigation. We propose an efficient differential privacy mechanism incorporating adaptive gradient clipping and gradient-aligned noise injection (GANI) to protect sensitive information while ensuring model performance. Our framework leverages truncated singular value decomposition for gradient processing, enabling precise control over the privacy-utility trade-off. Comprehensive performance evaluations on benchmark datasets (OxIOD, RIDI, RoNIN) demonstrate that ConvXformer surpasses state-of-the-art methods, achieving more than 40% improvement in positioning accuracy while ensuring (ε,δ)-differential privacy guarantees. To validate real-world performance, we introduce the Mech-IO dataset, collected from the mechanical engineering building at KAIST, where intense magnetic fields from industrial equipment induce significant sensor perturbations. This demonstrated robustness under severe environmental distortions makes our framework well-suited for secure and intelligent navigation in cyber-physical systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 46 references that are in the map. First posted on arXiv 22 Oct 2025.

Builds on

15 of 46 references.

References · 15

  1. 2022A ConvNet for the 2020scited by 3,545
  2. 2016Deep Learning with Differential Privacycited by 2,682
  3. 2018Subsampled R'enyi Differential Privacy and Analytical Moments Accountantcited by 234
  4. 2021Evaluating Gradient Inversion Attacks and Defenses in Federated Learningcited by 196
  5. 2021Practical and Private (Deep) Learning without Sampling or Shufflingcited by 169
  6. 2019AdaCliP: Adaptive Clipping for Private SGDcited by 77
  7. 2019RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, and New Methodscited by 72
  8. 2018IONet: Learning to Cure the Curse of Drift in Inertial Odometrycited by 52
  9. 2017RIDI: Robust IMU Double Integrationcited by 41
  10. 2023Deep Learning for Inertial Positioning: A Surveycited by 20
  11. 2020Deep Learning based Pedestrian Inertial Navigation: Methods, Dataset and On-Device Inferencecited by 16
  12. 2021CTIN: Robust Contextual Transformer Network for Inertial Navigationcited by 12
3 more
  1. 2024iMoT: Inertial Motion Transformer for Inertial Navigationcited by 6
  2. 2024Delving into Differentially Private Transformercited by 5
  3. 2024DPDR: Gradient Decomposition and Reconstruction for Differentially Private Deep Learningcited by 4

Built on by

Not cited yet.