Perspective Fields for Single Image Camera Calibration
Not on the map. Why?
Abstract (arXiv)
Geometric camera calibration is often required for applications that understand the perspective of the image. We propose perspective fields as a representation that models the local perspective properties of an image. Perspective Fields contain per-pixel information about the camera view, parameterized as an up vector and a latitude value. This representation has a number of advantages as it makes minimal assumptions about the camera model and is invariant or equivariant to common image editing operations like cropping, warping, and rotation. It is also more interpretable and aligned with human perception. We train a neural network to predict Perspective Fields and the predicted Perspective Fields can be converted to calibration parameters easily. We demonstrate the robustness of our approach under various scenarios compared with camera calibration-based methods and show example applications in image compositing.
Key facts. Cited by 75 papers in the map (data through 7 Oct 2026). Builds on 20 of its 55 references that are in the map. First posted on arXiv 6 Dec 2022.
Builds on
20 of 55 references.
References · 20
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2022A ConvNet for the 2020scited by 3,545
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2018Albumentations: fast and flexible image augmentationscited by 558
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2019PointRend: Image Segmentation as Renderingcited by 439
- 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 404
- 2020Objectron: A Large Scale Dataset of Object-Centric Videos in the Wild with Pose Annotationscited by 155
- 2017A Perceptual Measure for Deep Single Image Camera Calibrationcited by 45
- 2018Context-Aware Synthesis and Placement of Object Instancescited by 41
8 more
- 2021CTRL-C: Camera calibration TRansformer with Line-Classificationcited by 33
- 2016Horizon Lines in the Wildcited by 30
- 2019Blind Geometric Distortion Correction on Images Through Deep Learningcited by 28
- 2016Detecting Vanishing Points using Global Image Context in a Non-Manhattan Worldcited by 27
- 2017Quantitative Analysis of Automatic Image Cropping Algorithms: A Dataset and Comparative Studycited by 26
- 2019UprightNet: Geometry-Aware Camera Orientation Estimation from Single Imagescited by 26
- 2020Single View Metrology in the Wildcited by 20
- 2020Neural Geometric Parser for Single Image Camera Calibrationcited by 13
Built on by
Citing papers per year: 2023: 8; 2024: 22; 2025: 22; 2026: 23.
75 papers.
Sort:
By area:
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 297
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
- 2024CameraHMR: Aligning People with Perspectivecited by 64
- 2023Shadows Don't Lie and Lines Can't Bend! Generative Models don't know Projective Geometry...for nowcited by 61
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 59
- 2024SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priorscited by 53
- 2024GeoCalib: Learning Single-image Calibration with Geometric Optimizationcited by 50
- 2024Cubify Anything: Scaling Indoor 3D Object Detectioncited by 39
- 2023FlowCam: Training Generalizable 3D Radiance Fields without Camera Poses via Pixel-Aligned Scene Flowcited by 38
38 more
- 2025Depth Any Camera: Zero-Shot Metric Depth Estimation from Any Cameracited by 38
- 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Modelscited by 37
- 2023Tame a Wild Camera: In-the-Wild Monocular Camera Calibrationcited by 34
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulationcited by 34
- 2023Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Modelcited by 29
- 2023PSDR-Room: Single Photo to Scene using Differentiable Renderingcited by 23
- 2023Deep Learning for Camera Calibration and Beyond: A Surveycited by 20
- 2025Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generationcited by 19
- 2023Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotationcited by 18
- 2024VersaT2I: Improving Text-to-Image Models with Versatile Rewardcited by 17
- 2025AnyCalib: On-Manifold Learning for Model-Agnostic Single-View Camera Calibrationcited by 17
- 2024ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusioncited by 16
- 2025PreciseCam: Precise Camera Control for Text-to-Image Generationcited by 13
- 2025Dual-Process Image Generationcited by 12
- 2026WildDet3D: Scaling Promptable 3D Detection in the Wildcited by 12
- 2025SceneMI: Motion In-betweening for Modeling Human-Scene Interactionscited by 11
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sourcescited by 10
- 2024DiffCalib: Reformulating Monocular Camera Calibration as Diffusion-Based Dense Incident Map Generationcited by 9
- 2024SDFit: 3D Object Pose and Shape by Fitting a Morphable SDF to a Single Imagecited by 9
- 2025GenSpace: Benchmarking Spatially-Aware Image Generationcited by 9
- 2025Towards Scalable Spatial Intelligence via 2D-to-3D Data Liftingcited by 8
- 2024Detecting Origin Attribution for Text-to-Image Diffusion Modelscited by 7
- 2024Boost 3D Reconstruction using Diffusion-based Monocular Camera Calibrationcited by 7
- 2026360Anything: Geometry-Free Lifting of Images and Videos to 360degcited by 7
- 2024Extreme Rotation Estimation in the Wildcited by 6
- 2025Spatiotemporally Consistent Indoor Lighting Estimation with Diffusion Priorscited by 5
- 2023Mitigating Perspective Distortion-induced Shape Ambiguity in Image Cropscited by 4
- 2025Bridging Vision Language Models and Symbolic Grounding for Video Question Answeringcited by 4
- 2024Floating No More: Object-Ground Reconstruction from a Single Imagecited by 3
- 2026PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstructioncited by 3
- 2024M"obius Transform for Mitigating Perspective Distortions in Representation Learningcited by 2
- 2024PaintScene4D: Consistent 4D Scene Generation from Text Promptscited by 2
- 2025AlignDiff: Learning Physically-Grounded Camera Alignment via Diffusioncited by 2
- 2025InFlux: A Benchmark for Self-Calibration of Dynamic Intrinsics of Video Camerascited by 2
- 2025GimbalDiffusion: Gravity-Aware Camera Control for Video Generationcited by 2
- 2026CalibAnyView: Beyond Single-View Camera Calibration in the Wildcited by 2
- 2026G3T Up! Gravity Aligned Coordinate Frames Simplify Pointmap Processingcited by 2
- 2024fCOP: Focal Length Estimation from Category-level Object Priorscited by 1
50 most cited of 75 All 75 (JSON)
- 2026PAGER: Partial-to-global Alignment via Geometric and Relational Distillation1 Oct 2026
- 2026Supervising Sound Localization by In-the-wild Egomotion1 Oct 2026
- 2026The Camera Inside the Editor: Reading the Implicit Camera of Image Editors with Painted Calibration Patterns29 Sep 2026
- 2026Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Cameras28 Sep 2026
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States3 Sep 2026
- 2026CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling1 Sep 2026
- 2026ORBIT++: Benchmarking SfM in the Wild with 360deg Video22 Aug 2026
- 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery20 Aug 2026
- 2026DAPM: UAV Monocular Depth Estimation from Any Height, Pitch, Roll and FOV23 Jul 2026
- 2026PRISM: Personalized Robotic Dataset Generation via Image-based Scene and Motion Synthesis6 Jul 2026
- 2026Cross-View Yaw Estimation in Location Uncertainty with Line-Aligning Yaw Scoring20 Jun 2026
- 2026Multi-HMR 2: Multi-Person Camera-Centric Human Detection, Mesh Recovery and Tracking12 Jun 2026
38 more
- 2026StereoGeo: an end-to-end stereo camera calibration method12 Jun 2026
- 2026G3T Up! Gravity Aligned Coordinate Frames Simplify Pointmap Processing26 May 2026
- 2026CalibAnyView: Beyond Single-View Camera Calibration in the Wild14 May 2026
- 2026WildDet3D: Scaling Promptable 3D Detection in the Wild9 Apr 2026
- 2026HiSpatial: Taming Hierarchical 3D Spatial Understanding in Vision-Language Models26 Mar 2026
- 2026Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completion24 Mar 2026
- 2026PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction6 Mar 2026
- 2026OpenVO: Open-World Visual Odometry with Temporal Dynamics Awareness22 Feb 2026
- 2026HeatMat: Simulation of City Material Impact on Urban Heat Island Effect30 Jan 2026
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources29 Jan 2026
- 2026360Anything: Geometry-Free Lifting of Images and Videos to 360deg22 Jan 2026
- 2025GimbalDiffusion: Gravity-Aware Camera Control for Video Generation9 Dec 2025
- 2025InFlux: A Benchmark for Self-Calibration of Dynamic Intrinsics of Video Cameras27 Oct 2025
- 2025Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generation9 Oct 2025
- 2025Tensor-Based Self-Calibration of Cameras via the TrifocalCalib Method22 Sep 2025
- 2025Bridging Vision Language Models and Symbolic Grounding for Video Question Answering15 Sep 2025
- 2025Spatiotemporally Consistent Indoor Lighting Estimation with Diffusion Priors11 Aug 2025
- 2025Towards Scalable Spatial Intelligence via 2D-to-3D Data Lifting24 Jul 2025
- 2025Dual-Process Image Generation2 Jun 2025
- 2025GenSpace: Benchmarking Spatially-Aware Image Generation30 May 2025
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation13 May 2025
- 2025Are Minimal Radial Distortion Solvers Really Necessary for Relative Pose Estimation?1 May 2025
- 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Models1 May 2025
- 2025PRaDA: Projective Radial Distortion Averaging23 Apr 2025
- 2025Acquisition of high-quality images for camera calibration in robotics applications via speech prompts15 Apr 2025
- 2025WorldScore: A Unified Evaluation Benchmark for World Generation1 Apr 2025
- 2025AlignDiff: Learning Physically-Grounded Camera Alignment via Diffusion27 Mar 2025
- 2025uLayout: Unified Room Layout Estimation for Perspective and Panoramic Images27 Mar 2025
- 2025SceneMI: Motion In-betweening for Modeling Human-Scene Interactions20 Mar 2025
- 2025AnyCalib: On-Manifold Learning for Model-Agnostic Single-View Camera Calibration16 Mar 2025
- 2025CoL3D: Collaborative Learning of Single-view Depth and Camera Intrinsics for Metric 3D Shape Recovery13 Feb 2025
- 2025PreciseCam: Precise Camera Control for Text-to-Image Generation22 Jan 2025
- 2025Depth Any Camera: Zero-Shot Metric Depth Estimation from Any Camera5 Jan 2025
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priors16 Dec 2024
- 2024PaintScene4D: Consistent 4D Scene Generation from Text Prompts5 Dec 2024
- 2024Cubify Anything: Scaling Indoor 3D Object Detection5 Dec 2024
- 2024Boost 3D Reconstruction using Diffusion-based Monocular Camera Calibration26 Nov 2024
- 2024CameraHMR: Aligning People with Perspective12 Nov 2024
50 newest of 75 All 75 (JSON)
- 2023Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Modelcited by 29
- 2024DiffCalib: Reformulating Monocular Camera Calibration as Diffusion-Based Dense Incident Map Generationcited by 9
- 2024Detecting Origin Attribution for Text-to-Image Diffusion Modelscited by 7
- 2024Boost 3D Reconstruction using Diffusion-based Monocular Camera Calibrationcited by 7
- 2025Spatiotemporally Consistent Indoor Lighting Estimation with Diffusion Priorscited by 5
- 2024PaintScene4D: Consistent 4D Scene Generation from Text Promptscited by 2
- 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recoverycited by 1
- 2026Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completioncited by 0
- 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery20 Aug 2026
- 2026Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completion24 Mar 2026
- 2025Spatiotemporally Consistent Indoor Lighting Estimation with Diffusion Priors11 Aug 2025
- 2024PaintScene4D: Consistent 4D Scene Generation from Text Prompts5 Dec 2024
- 2024Boost 3D Reconstruction using Diffusion-based Monocular Camera Calibration26 Nov 2024
- 2024DiffCalib: Reformulating Monocular Camera Calibration as Diffusion-Based Dense Incident Map Generation24 May 2024
- 2024Detecting Origin Attribution for Text-to-Image Diffusion Models28 Mar 2024
- 2023Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Model20 Dec 2023
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 297
- 2024SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priorscited by 53
- 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Modelscited by 37
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulationcited by 34
- 2026HiSpatial: Taming Hierarchical 3D Spatial Understanding in Vision-Language Modelscited by 1
- 2026HiSpatial: Taming Hierarchical 3D Spatial Understanding in Vision-Language Models26 Mar 2026
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation13 May 2025
- 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Models1 May 2025
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun 2024
- 2024SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priors18 Mar 2024
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
- 2024CameraHMR: Aligning People with Perspectivecited by 64
- 2023Shadows Don't Lie and Lines Can't Bend! Generative Models don't know Projective Geometry...for nowcited by 61
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 59
- 2024GeoCalib: Learning Single-image Calibration with Geometric Optimizationcited by 50
- 2024Cubify Anything: Scaling Indoor 3D Object Detectioncited by 39
- 2023FlowCam: Training Generalizable 3D Radiance Fields without Camera Poses via Pixel-Aligned Scene Flowcited by 38
- 2025Depth Any Camera: Zero-Shot Metric Depth Estimation from Any Cameracited by 38
- 2023Tame a Wild Camera: In-the-Wild Monocular Camera Calibrationcited by 34
12 most cited of 60 All 60 (JSON)
- 2026PAGER: Partial-to-global Alignment via Geometric and Relational Distillation1 Oct 2026
- 2026Supervising Sound Localization by In-the-wild Egomotion1 Oct 2026
- 2026The Camera Inside the Editor: Reading the Implicit Camera of Image Editors with Painted Calibration Patterns29 Sep 2026
- 2026Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Cameras28 Sep 2026
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States3 Sep 2026
- 2026CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling1 Sep 2026
- 2026ORBIT++: Benchmarking SfM in the Wild with 360deg Video22 Aug 2026
- 2026DAPM: UAV Monocular Depth Estimation from Any Height, Pitch, Roll and FOV23 Jul 2026
- 2026Cross-View Yaw Estimation in Location Uncertainty with Line-Aligning Yaw Scoring20 Jun 2026
- 2026Multi-HMR 2: Multi-Person Camera-Centric Human Detection, Mesh Recovery and Tracking12 Jun 2026
- 2026StereoGeo: an end-to-end stereo camera calibration method12 Jun 2026
- 2026G3T Up! Gravity Aligned Coordinate Frames Simplify Pointmap Processing26 May 2026
12 newest of 60 All 60 (JSON)