Privacy Preserving Image-Based Localization
Not on the map. Why?
Abstract (arXiv)
Image-based localization is a core component of many augmented/mixed reality (AR/MR) and autonomous robotic systems. Current localization systems rely on the persistent storage of 3D point clouds of the scene to enable camera pose estimation, but such data reveals potentially sensitive scene information. This gives rise to significant privacy risks, especially as for many applications 3D mapping is a background process that the user might not be fully aware of. We pose the following question: How can we avoid disclosing confidential information about the captured 3D scene, and yet allow reliable camera pose estimation? This paper proposes the first solution to what we call privacy preserving image-based localization. The key idea of our approach is to lift the map representation from a 3D point cloud to a 3D line cloud. This novel representation obfuscates the underlying scene geometry while providing sufficient geometric constraints to enable robust and accurate 6-DOF camera pose estimation. Extensive experiments on several datasets and localization scenarios underline the high practical relevance of our proposed approach.
Key facts. Cited by 47 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 10; 2024: 7; 2025: 11; 2026: 9.
47 papers.
Sort:
By area:
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 100
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
- 2023An Outlook into the Future of Egocentric Visioncited by 84
- 2022Is Geometry Enough for Matching in Visual Localization?cited by 48
- 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understandingcited by 38
- 2025MP-SfM: Monocular Surface Priors for Robust Structure-from-Motioncited by 26
- 2021NinjaDesc: Content-Concealing Visual Descriptors via Adversarial Learningcited by 21
- 2021How Privacy-Preserving are Line Clouds? Recovering Scene Details from 3D Linescited by 19
- 2023Deep Learning for Visual Localization and Mapping: A Surveycited by 14
- 2024LoD-Loc: Aerial Visual Localization using LoD 3D Map with Neural Wireframe Alignmentcited by 13
- 2021NYU-VPR: Long-Term Visual Place Recognition Benchmark with View Direction and Data Anonymization Influencescited by 12
35 more
- 2024Fully Geometric Panoramic Localizationcited by 11
- 2021Analysis and Mitigations of Reverse Engineering Attacks on Local Feature Descriptorscited by 10
- 2023LDP-Feat: Image Features with Local Differential Privacycited by 10
- 2025Gaussian Splatting Feature Fields for Privacy-Preserving Visual Localizationcited by 10
- 2023Privacy-Preserving Representations are not Enough -- Recovering Scene Content from Camera Posescited by 7
- 2022Progressive Cross-modal Knowledge Distillation for Human Action Recognitioncited by 6
- 2022Privacy-Preserving Visual Localization with Event Camerascited by 6
- 2024Obfuscation Based Privacy Preserving Representations are Recoverable Using Neighborhood Informationcited by 6
- 2024Improved Scene Landmark Detection for Camera Localizationcited by 4
- 2025EgoPrivacy: What Your First-Person Camera Says About You?cited by 4
- 2023LDL: Line Distance Functions for Panoramic Localizationcited by 3
- 2023Active Visual Localization for Multi-Agent Collaboration: A Data-Driven Approachcited by 3
- 2024Representing 3D sparse map points and lines for camera relocalizationcited by 3
- 2024Lifelong Learning and Selective Forgetting via Contrastive Strategycited by 3
- 2024Reprojection Errors as Prompts for Efficient Scene Coordinate Regressioncited by 3
- 2025A2-GNN: Angle-Annular GNN for Visual Descriptor-free Camera Relocalizationcited by 3
- 2025Can we make NeRF-based visual localization privacy-preserving?cited by 3
- 2025Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splattingcited by 2
- 2023The Need for Inherently Privacy-Preserving Vision in Trustworthy Autonomous Systemscited by 1
- 2025Is there anything left? Measuring semantic residuals of objects removed from 3D Gaussian Splattingcited by 1
- 20254D3R: Motion-Aware Neural Reconstruction and Rendering of Dynamic Scenes from Monocular Videoscited by 1
- 2026Depth-Guided Privacy-Preserving Visual Localization Using 3D Sphere Cloudscited by 1
- 2021Improving the Behaviour of Vision Transformers with Token-consistent Stochastic Layerscited by 0
- 2022Learning to Censor by Noisy Samplingcited by 0
- 2025Multiview Image-Based Localizationcited by 0
- 2025RL-MoE: An Image-Based Privacy Preserving Approach In Intelligent Transportation Systemcited by 0
- 2025A Distributed Framework for Privacy-Enhanced Vision Transformers on the Edgecited by 0
- 2026PPEDCRF: Privacy-Preserving Enhanced Dynamic CRF for Location-Privacy Protection for Sequence Videos with Minimal Detection Degradationcited by 0
- 2026Privacy-Preserving Structureless Visual Localization via Image Obfuscationcited by 0
- 2026PPEDCRF: Dynamic-CRF-Guided Selective Perturbation for Background-Based Location Privacy in Video Sequencescited by 0
- 2026Revisiting Geometric Obfuscation with Dual Convergent Lines for Privacy-Preserving Image Queries in Visual Localizationcited by 0
- 2026Seeing Through the Weights: Privacy Leakage in Scene Coordinate Regressioncited by 0
- 2026GeoMix: Descriptor-Free Visual Localization via Global Context and Multi-Detector Trainingcited by 0
- 2026TrustCLIP: Learning Private Visual Features via Adversarial Reconstructioncited by 0
- 2026Misanthrope: A Privacy-Preserving Keypoint Detectorcited by 0
- 2026Misanthrope: A Privacy-Preserving Keypoint Detector24 Aug 2026
- 2026TrustCLIP: Learning Private Visual Features via Adversarial Reconstruction5 Jul 2026
- 2026GeoMix: Descriptor-Free Visual Localization via Global Context and Multi-Detector Training2 Jul 2026
- 2026Seeing Through the Weights: Privacy Leakage in Scene Coordinate Regression30 Jun 2026
- 2026Depth-Guided Privacy-Preserving Visual Localization Using 3D Sphere Clouds1 May 2026
- 2026Revisiting Geometric Obfuscation with Dual Convergent Lines for Privacy-Preserving Image Queries in Visual Localization24 Apr 2026
- 2026PPEDCRF: Dynamic-CRF-Guided Selective Perturbation for Background-Based Location Privacy in Video Sequences18 Apr 2026
- 2026Privacy-Preserving Structureless Visual Localization via Image Obfuscation13 Apr 2026
- 2026PPEDCRF: Privacy-Preserving Enhanced Dynamic CRF for Location-Privacy Protection for Sequence Videos with Minimal Detection Degradation2 Mar 2026
- 2025A Distributed Framework for Privacy-Enhanced Vision Transformers on the Edge10 Dec 2025
- 20254D3R: Motion-Aware Neural Reconstruction and Rendering of Dynamic Scenes from Monocular Videos7 Nov 2025
- 2025Can we make NeRF-based visual localization privacy-preserving?26 Aug 2025
35 more
- 2025Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splatting15 Aug 2025
- 2025RL-MoE: An Image-Based Privacy Preserving Approach In Intelligent Transportation System7 Aug 2025
- 2025Gaussian Splatting Feature Fields for Privacy-Preserving Visual Localization31 Jul 2025
- 2025EgoPrivacy: What Your First-Person Camera Says About You?13 Jun 2025
- 2025MP-SfM: Monocular Surface Priors for Robust Structure-from-Motion28 Apr 2025
- 2025Multiview Image-Based Localization30 Mar 2025
- 2025Is there anything left? Measuring semantic residuals of objects removed from 3D Gaussian Splatting21 Mar 2025
- 2025A2-GNN: Angle-Annular GNN for Visual Descriptor-free Camera Relocalization27 Feb 2025
- 2024LoD-Loc: Aerial Visual Localization using LoD 3D Map with Neural Wireframe Alignment16 Oct 2024
- 2024Obfuscation Based Privacy Preserving Representations are Recoverable Using Neighborhood Information17 Sep 2024
- 2024Reprojection Errors as Prompts for Efficient Scene Coordinate Regression6 Sep 2024
- 2024Lifelong Learning and Selective Forgetting via Contrastive Strategy28 May 2024
- 2024Fully Geometric Panoramic Localization29 Mar 2024
- 2024Representing 3D sparse map points and lines for camera relocalization28 Feb 2024
- 2024Improved Scene Landmark Detection for Camera Localization31 Jan 2024
- 2023Active Visual Localization for Multi-Agent Collaboration: A Data-Driven Approach4 Oct 2023
- 2023Deep Learning for Visual Localization and Mapping: A Survey27 Aug 2023
- 2023LDL: Line Distance Functions for Panoramic Localization27 Aug 2023
- 2023LDP-Feat: Image Features with Local Differential Privacy22 Aug 2023
- 2023An Outlook into the Future of Egocentric Vision14 Aug 2023
- 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understanding8 Jun 2023
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Poses23 May 2023
- 2023Privacy-Preserving Representations are not Enough -- Recovering Scene Content from Camera Poses8 May 2023
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matching4 Apr 2023
- 2023The Need for Inherently Privacy-Preserving Vision in Trustworthy Autonomous Systems29 Mar 2023
- 2022Privacy-Preserving Visual Localization with Event Cameras4 Dec 2022
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Reality19 Oct 2022
- 2022Progressive Cross-modal Knowledge Distillation for Human Action Recognition17 Aug 2022
- 2022Is Geometry Enough for Matching in Visual Localization?24 Mar 2022
- 2022Learning to Censor by Noisy Sampling23 Mar 2022
- 2021Improving the Behaviour of Vision Transformers with Token-consistent Stochastic Layers30 Dec 2021
- 2021NinjaDesc: Content-Concealing Visual Descriptors via Adversarial Learning23 Dec 2021
- 2021NYU-VPR: Long-Term Visual Place Recognition Benchmark with View Direction and Data Anonymization Influences18 Oct 2021
- 2021Analysis and Mitigations of Reverse Engineering Attacks on Local Feature Descriptors9 May 2021
- 2021How Privacy-Preserving are Line Clouds? Recovering Scene Details from 3D Lines8 Mar 2021
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 100
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
- 2023An Outlook into the Future of Egocentric Visioncited by 84
- 2022Is Geometry Enough for Matching in Visual Localization?cited by 48
- 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understandingcited by 38
- 2025MP-SfM: Monocular Surface Priors for Robust Structure-from-Motioncited by 26
- 2021NinjaDesc: Content-Concealing Visual Descriptors via Adversarial Learningcited by 21
- 2021How Privacy-Preserving are Line Clouds? Recovering Scene Details from 3D Linescited by 19
- 2023Deep Learning for Visual Localization and Mapping: A Surveycited by 14
- 2024LoD-Loc: Aerial Visual Localization using LoD 3D Map with Neural Wireframe Alignmentcited by 13
- 2021NYU-VPR: Long-Term Visual Place Recognition Benchmark with View Direction and Data Anonymization Influencescited by 12
12 most cited of 46 All 46 (JSON)
- 2026Misanthrope: A Privacy-Preserving Keypoint Detector24 Aug 2026
- 2026GeoMix: Descriptor-Free Visual Localization via Global Context and Multi-Detector Training2 Jul 2026
- 2026Seeing Through the Weights: Privacy Leakage in Scene Coordinate Regression30 Jun 2026
- 2026Depth-Guided Privacy-Preserving Visual Localization Using 3D Sphere Clouds1 May 2026
- 2026Revisiting Geometric Obfuscation with Dual Convergent Lines for Privacy-Preserving Image Queries in Visual Localization24 Apr 2026
- 2026PPEDCRF: Dynamic-CRF-Guided Selective Perturbation for Background-Based Location Privacy in Video Sequences18 Apr 2026
- 2026Privacy-Preserving Structureless Visual Localization via Image Obfuscation13 Apr 2026
- 2026PPEDCRF: Privacy-Preserving Enhanced Dynamic CRF for Location-Privacy Protection for Sequence Videos with Minimal Detection Degradation2 Mar 2026
- 2025A Distributed Framework for Privacy-Enhanced Vision Transformers on the Edge10 Dec 2025
- 20254D3R: Motion-Aware Neural Reconstruction and Rendering of Dynamic Scenes from Monocular Videos7 Nov 2025
- 2025Can we make NeRF-based visual localization privacy-preserving?26 Aug 2025
- 2025Remove360: Benchmarking Residuals After Object Removal in 3D Gaussian Splatting15 Aug 2025
12 newest of 46 All 46 (JSON)