# FishEyeRecNet: A Multi-Context Collaborative Deep Network for Fisheye Image Rectification

arXiv: https://arxiv.org/abs/1804.04784 · HTML: https://mlsanity.com/paper/1804.04784/

## Key facts

- Cited by 32 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Apr 2018.

## Built on by (most cited first, 30 of 32)

- [Progressively Complementary Network for Fisheye Image Rectification Using Appearance Flow](https://mlsanity.com/paper/2103.16026/) (2021)
- [Deep Learning for Camera Calibration and Beyond: A Survey](https://mlsanity.com/paper/2303.10559/) (2023)
- [Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generation](https://mlsanity.com/paper/2510.08673/) (2025)
- [Self-Supervised Camera Self-Calibration from Video](https://mlsanity.com/paper/2112.03325/) (2021)
- [Adaptable Deformable Convolutions for Semantic Segmentation of Fisheye Images in Autonomous Driving Systems](https://mlsanity.com/paper/2102.10191/) (2021)
- [SimFIR: A Simple Framework for Fisheye Image Rectification with Self-supervised Representation Learning](https://mlsanity.com/paper/2308.09040/) (2023)
- [FisheyeHDK: Hyperbolic Deformable Kernel Learning for Ultra-Wide Field-of-View Image Recognition](https://mlsanity.com/paper/2203.07255/) (2022)
- [DarSwin: Distortion Aware Radial Swin Transformer](https://mlsanity.com/paper/2304.09691/) (2023)
- [FishFormer: Annulus Slicing-based Transformer for Fisheye Rectification with Efficacy Domain Exploration](https://mlsanity.com/paper/2207.01925/) (2022)
- [Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens](https://mlsanity.com/paper/2508.04928/) (2025)
- [RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning](https://mlsanity.com/paper/2301.01661/) (2023)
- [Rethinking Generic Camera Models for Deep Single Image Camera Calibration to Recover Rotation and Fisheye Distortion](https://mlsanity.com/paper/2111.12927/) (2021)
- [Exploiting the Distortion-Semantic Interaction in Fisheye Data](https://mlsanity.com/paper/2305.00079/) (2023)
- [Dual Diffusion Architecture for Fisheye Image Rectification: Synthetic-to-Real Generalization](https://mlsanity.com/paper/2301.11785/) (2023)
- [Correcting Face Distortion in Wide-Angle Videos](https://mlsanity.com/paper/2111.09950/) (2021)
- [Edge-competing Pathological Liver Vessel Segmentation with Limited Labels](https://mlsanity.com/paper/2108.00384/) (2021)
- [FisheyeEX: Polar Outpainting for Extending the FoV of Fisheye Lens](https://mlsanity.com/paper/2206.05844/) (2022)
- [Spatiotemporal Deformation Perception for Fisheye Video Rectification](https://mlsanity.com/paper/2302.03934/) (2023)
- [FishRecGAN: An End to End GAN Based Network for Fisheye Rectification and Calibration](https://mlsanity.com/paper/2305.05222/) (2023)
- [M"obius Transform for Mitigating Perspective Distortions in Representation Learning](https://mlsanity.com/paper/2405.02296/) (2024)
- [Visual Boundary Knowledge Translation for Foreground Segmentation](https://mlsanity.com/paper/2108.00379/) (2021)
- [Learning Pixel-Adaptive Weights for Portrait Photo Retouching](https://mlsanity.com/paper/2112.03536/) (2021)
- [Deep network for rolling shutter rectification](https://mlsanity.com/paper/2112.06170/) (2021)
- [Rectifying homographies for stereo vision: analytical solution for minimal distortion](https://mlsanity.com/paper/2203.00123/) (2022)
- [DarSwin-Unet: Distortion Aware Encoder-Decoder Architecture](https://mlsanity.com/paper/2407.17328/) (2024)
- [QueryCDR: Query-Based Controllable Distortion Rectification Network for Fisheye Images](https://mlsanity.com/paper/2412.13496/) (2024)
- [Learning-Based Framework for Camera Calibration with Distortion Correction and High Precision Feature Detection](https://mlsanity.com/paper/2202.00158/) (2022)
- [Multi-task Learning for Camera Calibration](https://mlsanity.com/paper/2211.12432/) (2022)
- [LCM: Log Conformal Maps for Robust Representation Learning to Mitigate Perspective Distortion](https://mlsanity.com/paper/2410.03686/) (2024)
- [Radial Distortion in Face Images: Detection and Impact](https://mlsanity.com/paper/2501.07179/) (2025)

## Abstract (arXiv)

Images captured by fisheye lenses violate the pinhole camera assumption and suffer from distortions. Rectification of fisheye images is therefore a crucial preprocessing step for many computer vision applications. In this paper, we propose an end-to-end multi-context collaborative deep network for removing distortions from single fisheye images. In contrast to conventional approaches, which focus on extracting hand-crafted features from input images, our method learns high-level semantics and low-level appearance features simultaneously to estimate the distortion parameters. To facilitate training, we construct a synthesized dataset that covers various scenes and distortion parameter settings. Experiments on both synthesized and real-world datasets show that the proposed model significantly outperforms current state of the art methods. Our code and synthesized dataset will be made publicly available.