Information-Theoretic Odometry Learning
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a unified information theoretic framework for learning-motivated methods aimed at odometry estimation, a crucial component of many robotics and vision tasks such as navigation and virtual reality where relative camera poses are required in real time. We formulate this problem as optimizing a variational information bottleneck objective function, which eliminates pose-irrelevant information from the latent representation. The proposed framework provides an elegant tool for performance evaluation and understanding in information-theoretic language. Specifically, we bound the generalization errors of the deep information bottleneck framework and the predictability of the latent representation. These provide not only a performance guarantee but also practical guidance for model design, sample collection, and sensor selection. Furthermore, the stochastic latent representation provides a natural uncertainty measure without the needs for extra structures or computations. Experiments on two well-known odometry datasets demonstrate the effectiveness of our method.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 39 of its 63 references that are in the map. First posted on arXiv 11 Mar 2022.
Builds on
39 of 63 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2016Deep Variational Information Bottleneckcited by 915
- 2015Deep Learning and the Information Bottleneck Principlecited by 793
27 more
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2019On Variational Bounds of Mutual Informationcited by 550
- 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
- 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
- 2016Entropy-SGD: Biasing Gradient Descent Into Wide Valleyscited by 357
- 2020Virtual KITTI 2cited by 345
- 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2017Information-theoretic analysis of generalization capability of learning algorithmscited by 299
- 2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
- 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
- 2021ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Biascited by 216
- 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
- 2017DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networkscited by 173
- 2019A General Framework for Uncertainty Estimation in Deep Learningcited by 119
- 2022ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyondcited by 117
- 2020Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Thingscited by 110
- 2019InfoBot: Transfer and Exploration via the Information Bottleneckcited by 78
- 2018Compressing Neural Networks using the Variational Information Bottleneckcited by 59
- 2019Visual Odometry Revisited: What Should Be Learnt?cited by 57
- 2017VINet: Visual-Inertial Odometry as a Sequence-to-Sequence Learning Problemcited by 51
- 2018Learning and Querying Fast Generative Models for Reinforcement Learningcited by 48
- 2020A Survey on Deep Learning for Localization and Mapping: Towards the Age of Spatial Machine Intelligencecited by 35
- 2019Selective Sensor Fusion for Neural Visual-Inertial Odometrycited by 34
- 2019Beyond Tracking: Selecting Memory and Refining Poses for Deep Visual Odometrycited by 27
- 2017DPC-Net: Deep Pose Correction for Visual Localizationcited by 5
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 1; 2025: 2.
5 papers.
- 2024InfoRM: Mitigating Reward Hacking in RLHF via Information-Theoretic Reward Modelingcited by 76
- 2022Towards Scale-Aware, Robust, and Generalizable Unsupervised Monocular Depth Estimation by Integrating IMU Motion Dynamicscited by 20
- 2023Event-based Simultaneous Localization and Mapping: A Comprehensive Surveycited by 17
- 2025Information-Theoretic Reward Modeling for Stable RLHF: Detecting and Mitigating Reward Hackingcited by 5
- 2025Discriminately Treating Motion Components Evolves Joint Depth and Ego-Motion Learningcited by 0
- 2025Discriminately Treating Motion Components Evolves Joint Depth and Ego-Motion Learning3 Nov 2025
- 2025Information-Theoretic Reward Modeling for Stable RLHF: Detecting and Mitigating Reward Hacking15 Oct 2025
- 2024InfoRM: Mitigating Reward Hacking in RLHF via Information-Theoretic Reward Modeling14 Feb 2024
- 2023Event-based Simultaneous Localization and Mapping: A Comprehensive Survey19 Apr 2023
- 2022Towards Scale-Aware, Robust, and Generalizable Unsupervised Monocular Depth Estimation by Integrating IMU Motion Dynamics11 Jul 2022