# Neural Real-Time Recalibration for Infrared Multi-Camera Systems

arXiv: https://arxiv.org/abs/2410.14505 · HTML: https://mlsanity.com/paper/2410.14505/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 4 of its 30 references that are in the map.
- First posted on arXiv 18 Oct 2024.

## Builds on (most cited first, 4 of 4)

- [A Perceptual Measure for Deep Single Image Camera Calibration](https://mlsanity.com/paper/1712.01259/) (2017)
- [MLPnP - A Real-Time Maximum Likelihood Solution to the Perspective-n-Point Problem](https://mlsanity.com/paper/1607.08112/) (2016)
- [Camera Calibration through Camera Projection Loss](https://mlsanity.com/paper/2110.03479/) (2021)
- [Learning Camera Miscalibration Detection](https://mlsanity.com/paper/2005.11711/) (2020)

## Built on by (most cited first, 1 of 1)

- [Marker-Based Extrinsic Calibration Method for Accurate Multi-Camera 3D Reconstruction](https://mlsanity.com/paper/2505.02539/) (2025)

## Abstract (arXiv)

Currently, there are no learning-free or neural techniques for real-time recalibration of infrared multi-camera systems. In this paper, we address the challenge of real-time, highly-accurate calibration of multi-camera infrared systems, a critical task for time-sensitive applications. Unlike traditional calibration techniques that lack adaptability and struggle with on-the-fly recalibrations, we propose a neural network-based method capable of dynamic real-time calibration. The proposed method integrates a differentiable projection model that directly correlates 3D geometries with their 2D image projections and facilitates the direct optimization of both intrinsic and extrinsic camera parameters. Key to our approach is the dynamic camera pose synthesis with perturbations in camera parameters, emulating realistic operational challenges to enhance model robustness. We introduce two model variants: one designed for multi-camera systems with onboard processing of 2D points, utilizing the direct 2D projections of 3D fiducials, and another for image-based systems, employing color-coded projected points for implicitly establishing correspondence. Through rigorous experimentation, we demonstrate our method is more accurate than traditional calibration techniques with or without perturbations while also being real-time, marking a significant leap in the field of real-time multi-camera system calibration. The source code can be found at https://github.com/theICTlab/neural-recalibration