# A Reliable Online Method for Joint Estimation of Focal Length and Camera Rotation

arXiv: https://arxiv.org/abs/2207.12934 · HTML: https://mlsanity.com/paper/2207.12934/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 5 of its 27 references that are in the map.
- First posted on arXiv 26 Jul 2022.

## Builds on (most cited first, 5 of 5)

- [A Perceptual Measure for Deep Single Image Camera Calibration](https://mlsanity.com/paper/1712.01259/) (2017)
- [Deep Hough-Transform Line Priors](https://mlsanity.com/paper/2007.09493/) (2020)
- [CTRL-C: Camera calibration TRansformer with Line-Classification](https://mlsanity.com/paper/2109.02259/) (2021)
- [UprightNet: Geometry-Aware Camera Orientation Estimation from Single Images](https://mlsanity.com/paper/1908.07070/) (2019)
- [Neural Geometric Parser for Single Image Camera Calibration](https://mlsanity.com/paper/2007.11855/) (2020)

## Built on by (most cited first, 5 of 5)

- [GeoCalib: Learning Single-image Calibration with Geometric Optimization](https://mlsanity.com/paper/2409.06704/) (2024)
- [3D Line Mapping Revisited](https://mlsanity.com/paper/2303.17504/) (2023)
- [Robust Incremental Structure-from-Motion with Hybrid Features](https://mlsanity.com/paper/2409.19811/) (2024)
- [Vanishing Point Estimation in Uncalibrated Images with Prior Gravity Direction](https://mlsanity.com/paper/2308.10694/) (2023)
- [Estimating Extreme 3D Image Rotation with Transformer Cross-Attention](https://mlsanity.com/paper/2303.02615/) (2023)

## Abstract (arXiv)

Linear perspectivecues deriving from regularities of the built environment can be used to recalibrate both intrinsic and extrinsic camera parameters online, but these estimates can be unreliable due to irregularities in the scene, uncertainties in line segment estimation and background clutter. Here we address this challenge through four initiatives. First, we use the PanoContext panoramic image dataset [27] to curate a novel and realistic dataset of planar projections over a broad range of scenes, focal lengths and camera poses. Second, we use this novel dataset and the YorkUrbanDB [4] to systematically evaluate the linear perspective deviation measures frequently found in the literature and show that the choice of deviation measure and likelihood model has a huge impact on reliability. Third, we use these findings to create a novel system for online camera calibration we call fR, and show that it outperforms the prior state of the art, substantially reducing error in estimated camera rotation and focal length. Our fourth contribution is a novel and efficient approach to estimating uncertainty that can dramatically improve online reliability for performance-critical applications by strategically selecting which frames to use for recalibration.
