mlsanityData to 14 Oct 2026

Shielding the Unseen: Privacy Protection through Poisoning NeRF with Spatial Deformation

arXiv 2310.03125 ↗First posted 4 Oct 2023cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

In this paper, we introduce an innovative method of safeguarding user privacy against the generative capabilities of Neural Radiance Fields (NeRF) models. Our novel poisoning attack method induces changes to observed views that are imperceptible to the human eye, yet potent enough to disrupt NeRF's ability to accurately reconstruct a 3D scene. To achieve this, we devise a bi-level optimization algorithm incorporating a Projected Gradient Descent (PGD)-based spatial deformation. We extensively test our approach on two common NeRF benchmark datasets consisting of 29 real-world scenes with high-quality images. Our results compellingly demonstrate that our privacy-preserving method significantly impairs NeRF's performance across these benchmark datasets. Additionally, we show that our method is adaptable and versatile, functioning across various perturbation strengths and NeRF architectures. This work offers valuable insights into NeRF's vulnerabilities and emphasizes the need to account for such potential privacy risks when developing robust 3D scene reconstruction algorithms. Our study contributes to the larger conversation surrounding responsible AI and generative machine learning, aiming to protect user privacy and respect creative ownership in the digital age.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 25 of its 39 references that are in the map. First posted on arXiv 4 Oct 2023.

Builds on

25 of 39 references.

References · 25

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  4. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  5. 2015Spatial Transformer Networkscited by 1,429
  6. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  7. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  8. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  9. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  10. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
  11. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
  12. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
13 more
  1. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
  2. 2018Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networkscited by 519
  3. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  4. 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
  5. 2020Free View Synthesiscited by 231
  6. 2017Towards Poisoning of Deep Learning Algorithms with Back-gradient Optimizationcited by 197
  7. 2018Spatially Transformed Adversarial Examplescited by 195
  8. 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
  9. 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
  10. 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 165
  11. 2020MetaPoison: Practical General-purpose Clean-label Data Poisoningcited by 120
  12. 2018Extreme View Synthesiscited by 94
  13. 2023Benchmarking Robustness in Neural Radiance Fieldscited by 13

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 2.

4 papers.