InSituNet: Deep Image Synthesis for Parameter Space Exploration of Ensemble Simulations
Not on the map. Why?
Abstract (arXiv)
We propose InSituNet, a deep learning based surrogate model to support parameter space exploration for ensemble simulations that are visualized in situ. In situ visualization, generating visualizations at simulation time, is becoming prevalent in handling large-scale simulations because of the I/O and storage constraints. However, in situ visualization approaches limit the flexibility of post-hoc exploration because the raw simulation data are no longer available. Although multiple image-based approaches have been proposed to mitigate this limitation, those approaches lack the ability to explore the simulation parameters. Our approach allows flexible exploration of parameter space for large-scale ensemble simulations by taking advantage of the recent advances in deep learning. Specifically, we design InSituNet as a convolutional regression model to learn the mapping from the simulation and visualization parameters to the visualization results. With the trained model, users can generate new images for different simulation parameters under various visualization settings, which enables in-depth analysis of the underlying ensemble simulations. We demonstrate the effectiveness of InSituNet in combustion, cosmology, and ocean simulations through quantitative and qualitative evaluations.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 5; 2023: 3; 2024: 10; 2025: 10; 2026: 5.
37 papers.
Sort:
By area:
- 2021Compressive Neural Representations of Volumetric Scalar Fieldscited by 64
- 2022GNN-Surrogate: A Hierarchical and Adaptive Graph Neural Network for Parameter Space Exploration of Unstructured-Mesh Ocean Simulationscited by 32
- 2022DL4SciVis: A State-of-the-Art Survey on Deep Learning for Scientific Visualizationcited by 32
- 2022VDL-Surrogate: A View-Dependent Latent-based Model for Parameter Space Exploration of Ensemble Simulationscited by 20
- 2023HyperINR: A Fast and Predictive Hypernetwork for Implicit Neural Representations via Knowledge Distillationcited by 19
- 2025NLI4VolVis: Natural Language Interaction for Volume Visualization via LLM Multi-Agents and Editable 3D Gaussian Splattingcited by 19
- 2025iVR-GS: Inverse Volume Rendering for Explorable Visualization via Editable 3D Gaussian Splattingcited by 17
- 2023ECNR: Efficient Compressive Neural Representation of Time-Varying Volumetric Datasetscited by 16
- 2021Deep Hierarchical Super Resolution for Scientific Datacited by 12
- 2024StyleRF-VolVis: Style Transfer of Neural Radiance Fields for Expressive Volume Visualizationcited by 9
- 2025TexGS-VolVis: Expressive Scene Editing for Volume Visualization via Textured Gaussian Splattingcited by 9
- 2025Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Explorationcited by 8
25 more
- 2021Exploratory Lagrangian-Based Particle Tracing Using Deep Learningcited by 7
- 2024ParamsDrag: Interactive Parameter Space Exploration via Image-Space Draggingcited by 6
- 2024Regularized Multi-Decoder Ensemble for an Error-Aware Scene Representation Networkcited by 6
- 2024HyperFLINT: Hypernetwork-based Flow Estimation and Temporal Interpolation for Scientific Ensemble Visualizationcited by 6
- 2024SurroFlow: A Flow-Based Surrogate Model for Parameter Space Exploration and Uncertainty Quantificationcited by 5
- 2021Deep Direct Volume Rendering: Learning Visual Feature Mappings From Exemplary Imagescited by 4
- 2024FLINT: Learning-based Flow Estimation and Temporal Interpolation for Scientific Ensemble Visualizationcited by 4
- 2022Accelerated Probabilistic Marching Cubes by Deep Learning for Time-Varying Scalar Ensemblescited by 3
- 2024Efficient Neural Representation of Volumetric Data using Coordinate-Based Networkscited by 3
- 2024Uncertainty-Aware Deep Neural Representations for Visual Analysis of Vector Field Datacited by 3
- 2024Uncertainty-Informed Volume Visualization using Implicit Neural Representationcited by 3
- 2025Illuminating LLM Coding Agents: Visual Analytics for Deeper Understanding and Enhancementcited by 3
- 2024Visual Analysis of Prediction Uncertainty in Neural Networks for Deep Image Synthesiscited by 2
- 2026ECoNGS: Efficient Compressive Neural Gaussian Splats for Volume Visualizationcited by 2
- 2022voxel2vec: A Natural Language Processing Approach to Learning Distributed Representations for Scientific Datacited by 1
- 2025ConfEviSurrogate: A Conformalized Evidential Surrogate Model for Uncertainty Quantificationcited by 1
- 2025Topology Guidance: Controlling the Outputs of Generative Models via Vector Field Topologycited by 1
- 2025FA-INR: Adaptive Implicit Neural Representations for Interpretable Exploration of Simulation Ensemblescited by 1
- 2026REV-INR: Regularized Evidential Implicit Neural Representation for Uncertainty-Aware Volume Visualizationcited by 1
- 2023Neural Stream Functionscited by 0
- 2025Seeing the Many: Exploring Parameter Distributions Conditioned on Features in Surrogatescited by 0
- 2025Compressive Modeling and Visualization of Multivariate Scientific Data using Implicit Neural Representationcited by 0
- 2026GS-Surrogate: Deformable Gaussian Splatting for Parameter Space Exploration of Ensemble Simulationscited by 0
- 2026Quantifying the Impact of Lossy Compression on Neural Generative Surrogate Modelingcited by 0
- 2026EVOLVE: Efficient Learned Volume Compression with Variable-Rate Encoding on a Cross-Domain Databasecited by 0
- 2026ECoNGS: Efficient Compressive Neural Gaussian Splats for Volume Visualization20 Jul 2026
- 2026EVOLVE: Efficient Learned Volume Compression with Variable-Rate Encoding on a Cross-Domain Database20 Jul 2026
- 2026Quantifying the Impact of Lossy Compression on Neural Generative Surrogate Modeling14 Jun 2026
- 2026GS-Surrogate: Deformable Gaussian Splatting for Parameter Space Exploration of Ensemble Simulations7 Apr 2026
- 2026REV-INR: Regularized Evidential Implicit Neural Representation for Uncertainty-Aware Volume Visualization25 Jan 2026
- 2025Compressive Modeling and Visualization of Multivariate Scientific Data using Implicit Neural Representation17 Oct 2025
- 2025Seeing the Many: Exploring Parameter Distributions Conditioned on Features in Surrogates18 Aug 2025
- 2025Illuminating LLM Coding Agents: Visual Analytics for Deeper Understanding and Enhancement18 Aug 2025
- 2025TexGS-VolVis: Expressive Scene Editing for Volume Visualization via Textured Gaussian Splatting18 Jul 2025
- 2025NLI4VolVis: Natural Language Interaction for Volume Visualization via LLM Multi-Agents and Editable 3D Gaussian Splatting16 Jul 2025
- 2025FA-INR: Adaptive Implicit Neural Representations for Interpretable Exploration of Simulation Ensembles7 Jun 2025
- 2025Topology Guidance: Controlling the Outputs of Generative Models via Vector Field Topology11 May 2025
25 more
- 2025iVR-GS: Inverse Volume Rendering for Explorable Visualization via Editable 3D Gaussian Splatting24 Apr 2025
- 2025ConfEviSurrogate: A Conformalized Evidential Surrogate Model for Uncertainty Quantification3 Apr 2025
- 2025Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Exploration1 Apr 2025
- 2024HyperFLINT: Hypernetwork-based Flow Estimation and Temporal Interpolation for Scientific Ensemble Visualization5 Dec 2024
- 2024FLINT: Learning-based Flow Estimation and Temporal Interpolation for Scientific Ensemble Visualization27 Sep 2024
- 2024Uncertainty-Informed Volume Visualization using Implicit Neural Representation12 Aug 2024
- 2024StyleRF-VolVis: Style Transfer of Neural Radiance Fields for Expressive Volume Visualization31 Jul 2024
- 2024Regularized Multi-Decoder Ensemble for an Error-Aware Scene Representation Network26 Jul 2024
- 2024Uncertainty-Aware Deep Neural Representations for Visual Analysis of Vector Field Data23 Jul 2024
- 2024ParamsDrag: Interactive Parameter Space Exploration via Image-Space Dragging19 Jul 2024
- 2024SurroFlow: A Flow-Based Surrogate Model for Parameter Space Exploration and Uncertainty Quantification16 Jul 2024
- 2024Visual Analysis of Prediction Uncertainty in Neural Networks for Deep Image Synthesis22 May 2024
- 2024Efficient Neural Representation of Volumetric Data using Coordinate-Based Networks16 Jan 2024
- 2023ECNR: Efficient Compressive Neural Representation of Time-Varying Volumetric Datasets2 Oct 2023
- 2023Neural Stream Functions16 Jul 2023
- 2023HyperINR: A Fast and Predictive Hypernetwork for Implicit Neural Representations via Knowledge Distillation9 Apr 2023
- 2022VDL-Surrogate: A View-Dependent Latent-based Model for Parameter Space Exploration of Ensemble Simulations25 Jul 2022
- 2022Accelerated Probabilistic Marching Cubes by Deep Learning for Time-Varying Scalar Ensembles15 Jul 2022
- 2022voxel2vec: A Natural Language Processing Approach to Learning Distributed Representations for Scientific Data6 Jul 2022
- 2022DL4SciVis: A State-of-the-Art Survey on Deep Learning for Scientific Visualization13 Apr 2022
- 2022GNN-Surrogate: A Hierarchical and Adaptive Graph Neural Network for Parameter Space Exploration of Unstructured-Mesh Ocean Simulations18 Feb 2022
- 2021Exploratory Lagrangian-Based Particle Tracing Using Deep Learning15 Oct 2021
- 2021Deep Direct Volume Rendering: Learning Visual Feature Mappings From Exemplary Images9 Jun 2021
- 2021Deep Hierarchical Super Resolution for Scientific Data30 May 2021
- 2021Compressive Neural Representations of Volumetric Scalar Fields11 Apr 2021
- 2021Compressive Neural Representations of Volumetric Scalar Fieldscited by 64
- 2022GNN-Surrogate: A Hierarchical and Adaptive Graph Neural Network for Parameter Space Exploration of Unstructured-Mesh Ocean Simulationscited by 32
- 2022DL4SciVis: A State-of-the-Art Survey on Deep Learning for Scientific Visualizationcited by 32
- 2022VDL-Surrogate: A View-Dependent Latent-based Model for Parameter Space Exploration of Ensemble Simulationscited by 20
- 2023HyperINR: A Fast and Predictive Hypernetwork for Implicit Neural Representations via Knowledge Distillationcited by 19
- 2025iVR-GS: Inverse Volume Rendering for Explorable Visualization via Editable 3D Gaussian Splattingcited by 17
- 2023ECNR: Efficient Compressive Neural Representation of Time-Varying Volumetric Datasetscited by 16
- 2021Deep Hierarchical Super Resolution for Scientific Datacited by 12
- 2024StyleRF-VolVis: Style Transfer of Neural Radiance Fields for Expressive Volume Visualizationcited by 9
- 2025TexGS-VolVis: Expressive Scene Editing for Volume Visualization via Textured Gaussian Splattingcited by 9
- 2025Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Explorationcited by 8
- 2021Exploratory Lagrangian-Based Particle Tracing Using Deep Learningcited by 7
12 most cited of 33 All 33 (JSON)
- 2026ECoNGS: Efficient Compressive Neural Gaussian Splats for Volume Visualization20 Jul 2026
- 2026EVOLVE: Efficient Learned Volume Compression with Variable-Rate Encoding on a Cross-Domain Database20 Jul 2026
- 2026Quantifying the Impact of Lossy Compression on Neural Generative Surrogate Modeling14 Jun 2026
- 2026GS-Surrogate: Deformable Gaussian Splatting for Parameter Space Exploration of Ensemble Simulations7 Apr 2026
- 2026REV-INR: Regularized Evidential Implicit Neural Representation for Uncertainty-Aware Volume Visualization25 Jan 2026
- 2025Compressive Modeling and Visualization of Multivariate Scientific Data using Implicit Neural Representation17 Oct 2025
- 2025Seeing the Many: Exploring Parameter Distributions Conditioned on Features in Surrogates18 Aug 2025
- 2025TexGS-VolVis: Expressive Scene Editing for Volume Visualization via Textured Gaussian Splatting18 Jul 2025
- 2025iVR-GS: Inverse Volume Rendering for Explorable Visualization via Editable 3D Gaussian Splatting24 Apr 2025
- 2025ConfEviSurrogate: A Conformalized Evidential Surrogate Model for Uncertainty Quantification3 Apr 2025
- 2025Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Exploration1 Apr 2025
- 2024HyperFLINT: Hypernetwork-based Flow Estimation and Temporal Interpolation for Scientific Ensemble Visualization5 Dec 2024
12 newest of 33 All 33 (JSON)