mlsanityData to 14 Oct 2026

ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Field

arXiv 2211.13226 ↗First posted 23 Nov 2022cs.CV cs.GRcited by 37

Not on the map. Why?

Abstract (arXiv)

Physical simulations produce excellent predictions of weather effects. Neural radiance fields produce SOTA scene models. We describe a novel NeRF-editing procedure that can fuse physical simulations with NeRF models of scenes, producing realistic movies of physical phenomena in those scenes. Our application -- Climate NeRF -- allows people to visualize what climate change outcomes will do to them. ClimateNeRF allows us to render realistic weather effects, including smog, snow, and flood. Results can be controlled with physically meaningful variables like water level. Qualitative and quantitative studies show that our simulated results are significantly more realistic than those from SOTA 2D image editing and SOTA 3D NeRF stylization.

Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). Builds on 59 of its 101 references that are in the map. First posted on arXiv 23 Nov 2022.

Builds on

59 of 101 references.

References · 59

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  5. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  7. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  8. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  9. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  10. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  11. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  12. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
38 more
  1. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  2. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  3. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  4. 2020Neural Sparse Voxel Fieldscited by 959
  5. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  6. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
  7. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
  8. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
  9. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
  10. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  11. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
  12. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
  13. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
  14. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  15. 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
  16. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
  17. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
  18. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  19. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
  20. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
  21. 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 216
  22. 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
  23. 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 205
  24. 2021EditGAN: High-Precision Semantic Image Editingcited by 156
  25. 2022ARF: Artistic Radiance Fieldscited by 147
  26. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 142
  27. 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
  28. 2021Hallucinated Neural Radiance Fields in the Wildcited by 130
  29. 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
  30. 2022Differentiable Point-Based Radiance Fields for Efficient View Synthesiscited by 86
  31. 2022Deforming Radiance Fields with Cagescited by 78
  32. 2020TSIT: A Simple and Versatile Framework for Image-to-Image Translationcited by 64
  33. 2022Physically-Based Editing of Indoor Scene Lighting from a Single Imagecited by 62
  34. 2022Improved Direct Voxel Grid Optimization for Radiance Fields Reconstructioncited by 61
  35. 2021DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Renderingcited by 60
  36. 2021Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigationcited by 53
  37. 2021Learning Neural Light Fields with Ray-Space Embedding Networkscited by 49
  38. 2022UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scenecited by 47

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 9; 2024: 11; 2025: 10; 2026: 7.

37 papers.

Sort:

By area:

  1. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
  2. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  3. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
  4. 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
  5. 2024Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editingcited by 45
  6. 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 37
  7. 2025Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigationcited by 30
  8. 2024AutoVFX: Physically Realistic Video Editing from Natural Language Instructionscited by 27
  9. 2023Choose Your Simulator Wisely: A Review on Open-source Simulators for Autonomous Drivingcited by 26
  10. 2024NeRF-HuGS: Improved Neural Radiance Fields in Non-static Scenes Using Heuristics-Guided Segmentationcited by 25
  11. 2023UrbanIR: Large-Scale Urban Scene Inverse Rendering from a Single Videocited by 22
  12. 2024Neural Fields in Robotics: A Surveycited by 21
25 more
  1. 2023Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Modelscited by 16
  2. 2024NeRFs in Robotics: A Surveycited by 16
  3. 2025RainyGS: Efficient Rain Synthesis with Physically-Based Gaussian Splattingcited by 13
  4. 2024Neural Radiance Field-based Visual Rendering: A Comprehensive Reviewcited by 12
  5. 2025WeatherEdit: Controllable Weather Editing with 4D Gaussian Fieldcited by 12
  6. 2025Controllable Weather Synthesis and Removal with Video Diffusion Modelscited by 11
  7. 2023Adv3D: Generating 3D Adversarial Examples for 3D Object Detection in Driving Scenarios with NeRFcited by 10
  8. 2025Let it Snow! Animating 3D Gaussian Scenes with Dynamic Weather Effects via Physics-Guided Score Distillationcited by 7
  9. 2024Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decompositioncited by 5
  10. 2025GPS as a Control Signal for Image Generationcited by 5
  11. 2025PromptVFX: Text-Driven Fields for Open-World 3D Gaussian Animationcited by 4
  12. 2025DrivingGaussian++: Towards Realistic Reconstruction and Editable Simulation for Surrounding Dynamic Driving Scenescited by 4
  13. 2023Progressive Volume Distillation with Active Learning for Efficient NeRF Architecture Conversioncited by 3
  14. 2025ClimateGS: Real-Time Climate Simulation with 3D Gaussian Style Transfercited by 2
  15. 2026WeatherCity: Urban Scene Reconstruction with Controllable Multi-Weather Transformationcited by 2
  16. 2026FieryGS: In-the-Wild Fire Synthesis with Physics-Integrated Gaussian Splattingcited by 2
  17. 2023Tube-NeRF: Efficient Imitation Learning of Visuomotor Policies from MPC using Tube-Guided Data Augmentation and NeRFscited by 1
  18. 2024Material Transforms from Disentangled NeRF Representationscited by 1
  19. 2024Editing Implicit and Explicit Representations of Radiance Fields: A Surveycited by 1
  20. 2025Resolution Revolution: A Physics-Guided Deep Learning Framework for Spatiotemporal Temperature Reconstructioncited by 1
  21. 2026FrozenDrive: Zero-Shot Text-Guided Driving Scene Generation and Data Augmentation with Parameter-Free Frozen Diffusion Modelcited by 1
  22. 2026Semantic-Aware, Physics-Informed, Geometry-Grounded Weather Video Synthesiscited by 1
  23. 2026MeGAS: Thermomechanical Dynamic Gaussian Splatting for Thermophysical Scene Editingcited by 0
  24. 2026Physics-aware Masked Diffusion-based Flood Simulation for Urban Fisheye Disaster Detectioncited by 0
  25. 2026MeteoVerse: Unified Weather-Controllable Video World Modelcited by 0