3D Smoke Scene Reconstruction Guided by Vision Priors from Multimodal Large Language Models
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Reconstructing 3D scenes from smoke-degraded multi-view images is particularly difficult because smoke introduces strong scattering effects, view-dependent appearance changes, and severe degradation of cross-view consistency. To address these issues, we propose a framework that integrates visual priors with efficient 3D scene modeling. We employ Nano-Banana-Pro to enhance smoke-degraded images and provide clearer visual observations for reconstruction and develop Smoke-GS, a medium-aware 3D Gaussian Splatting framework for smoke scene reconstruction and restoration-oriented novel view synthesis. Smoke-GS models the scene using explicit 3D Gaussians and introduces a lightweight view-dependent medium branch to capture direction-dependent appearance variations caused by smoke. Our method preserves the rendering efficiency of 3D Gaussian Splatting while improving robustness to smoke-induced degradation. Results demonstrate the effectiveness of our method for generating consistent and visually clear novel views in challenging smoke environments.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 38 of its 63 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
38 of 63 references.
References · 38
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
- 2016DehazeNet: An End-to-End System for Single Image Haze Removalcited by 314
- 2022Vision Transformers for Single Image Dehazingcited by 260
- 2020Multi-Scale Boosted Dehazing Network with Dense Feature Fusioncited by 230
- 2022Optimizing Prompts for Text-to-Image Generationcited by 207
- 2024One-Step Image Translation with Text-to-Image Modelscited by 116
26 more
- 2023MB-TaylorFormer: Multi-branch Efficient Transformer Expanded by Taylor Formula for Image Dehazingcited by 81
- 2022Unsupervised Night Image Enhancement: When Layer Decomposition Meets Light-Effects Suppressioncited by 73
- 2024Benchmarking Micro-action Recognition: Dataset, Methods, and Applicationscited by 48
- 2023Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streakscited by 45
- 2024WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian Splattingcited by 41
- 2024SeaSplat: Representing Underwater Scenes with 3D Gaussian Splatting and a Physically Grounded Image Formation Modelcited by 36
- 2023ScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural Renderingcited by 28
- 2024Frequency Decoupling for Motion Magnification via Multi-Level Isomorphic Architecturecited by 28
- 2023EulerMormer: Robust Eulerian Motion Magnification via Dynamic Filtering within Transformercited by 27
- 2024Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraintcited by 24
- 2025RealX3D: A Physically-Degraded 3D Benchmark for Multi-view Visual Restoration and Reconstructioncited by 19
- 2025I2-NeRF: Learning Neural Radiance Fields Under Physically-Grounded Media Interactionscited by 17
- 2022SnowFormer: Context Interaction Transformer with Scale-awareness for Single Image Desnowingcited by 13
- 2024GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restorationcited by 13
- 2026GenSmoke-GS: A Multi-Stage Method for Novel View Synthesis from Smoke-Degraded Images Using a Generative Modelcited by 11
- 2026NTIRE 2026 3D Restoration and Reconstruction in Real-world Adverse Conditions: RealX3D Challenge Resultscited by 11
- 2026XInsight: Integrative Stage-Consistent Psychological Counseling Support Agents for Digital Well-Beingcited by 9
- 2025AquaNeRF: Neural Radiance Fields in Underwater Media with Distractor Removalcited by 8
- 2025Plenodium: UnderWater 3D Scene Reconstruction with Plenoptic Medium Representationcited by 7
- 2025Task-Generalized Adaptive Cross-Domain Learning for Multimodal Image Fusioncited by 5
- 2023Dehazing-NeRF: Neural Radiance Fields from Hazy Imagescited by 4
- 2024NeuroPump: Simultaneous Geometric and Color Rectification for Underwater Imagescited by 4
- 2025BVINet: Unlocking Blind Video Inpainting with Zero Annotationscited by 4
- 2025Towards Seamless Interaction: Causal Turn-Level Modeling of Interactive 3D Conversational Head Dynamicscited by 3
- 2026Multimodal Protein Language Models for Enzyme Kinetic Parameters: From Substrate Recognition to Conformational Adaptationcited by 2
- 2024Joint Spatial-Temporal Modeling and Contrastive Learning for Self-supervised Heart Rate Measurementcited by 1
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Dual-Branch Remote Sensing Infrared Image Super-Resolutioncited by 7
- 2026Training-Free Model Ensemble for Single-Image Super-Resolution via Strong-Branch Compensationcited by 6
- 2026Beyond Model Design: Data-Centric Training and Self-Ensemble for Gaussian Color Image Denoisingcited by 5
- 2026ELoG-GS: Dual-Branch Gaussian Splatting with Luminance-Guided Enhancement for Extreme Low-light 3D Reconstructioncited by 1
- 2026Dehaze-then-Splat: Generative Dehazing with Physics-Informed 3D Gaussian Splatting for Smoke-Free Novel View Synthesiscited by 1
- 2026Robust Incomplete Multimodal Sentiment Analysis via Iterative Proxy Correctioncited by 0
- 2026FujinSplat: Seeing Through Smoke with RAW-Domain Gaussian Splattingcited by 0
- 2026FujinSplat: Seeing Through Smoke with RAW-Domain Gaussian Splatting5 Sep 2026
- 2026Robust Incomplete Multimodal Sentiment Analysis via Iterative Proxy Correction20 Aug 2026
- 2026Dehaze-then-Splat: Generative Dehazing with Physics-Informed 3D Gaussian Splatting for Smoke-Free Novel View Synthesis15 Apr 2026
- 2026ELoG-GS: Dual-Branch Gaussian Splatting with Luminance-Guided Enhancement for Extreme Low-light 3D Reconstruction14 Apr 2026
- 2026Training-Free Model Ensemble for Single-Image Super-Resolution via Strong-Branch Compensation13 Apr 2026
- 2026Beyond Model Design: Data-Centric Training and Self-Ensemble for Gaussian Color Image Denoising13 Apr 2026
- 2026Dual-Branch Remote Sensing Infrared Image Super-Resolution11 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025SmokeSVD: Smoke Reconstruction from A Single View via Progressive Novel View Synthesis and Refinement with Diffusion Models
- 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors
- 2026GIFSplat: Generative Prior-Guided Iterative Feed-Forward 3D Gaussian Splatting from Sparse Views
- 2025Breaking the Vicious Cycle: Coherent 3D Gaussian Splatting from Sparse and Motion-Blurred Views
- 2025FixingGS: Enhancing 3D Gaussian Splatting via Training-Free Score Distillation
- 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction
- 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors