FA-INR: Adaptive Implicit Neural Representations for Interpretable Exploration of Simulation Ensembles
On the map: Mixture-of-experts → Vision mixture-of-experts
Abstract (arXiv)
Surrogate models are essential for efficient exploration of large-scale ensemble simulations. Implicit neural representations (INRs) provide a compact and continuous framework for modeling spatially structured data, but they often struggle with learning complex localized structures within the scientific fields. Recent INR-based surrogates address this by augmenting INRs with explicit feature structures, but at the cost of flexibility and substantial memory overhead. In this paper, we present Feature-Adaptive INR (FA-INR), an adaptive INR-based surrogate model for high-fidelity and interpretable exploration of ensemble simulations. Instead of relying on structured feature representations, FA-INR leverages cross-attention over a learnable key-value memory bank to allocate model capacity adaptively based on the data characteristics. To further improve scalability, we introduce a coordinate-guided mixture of experts (MoE) framework that enhances both efficiency and specialization of feature representations. More importantly, the learned experts produce an interpretable partition over the simulation domain, enabling scientists to identify complex structures and perform localized parameter-space exploration. Beyond quantitative and qualitative evaluations, we also demonstrate that our learned expert specialization can reveal meaningful scientific insights and support localized sensitivity analysis.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Vision mixture-of-experts, one of 12 directions in Mixture-of-experts. Builds on 50 of its 65 references that are in the map. First posted on arXiv 7 Jun 2025.
Builds on
50 of 65 references.
Closest ancestors · 4
Same direction, newest first
- 2024Neural Experts: Mixture of Experts for Implicit Neural Representations29 Oct
- 2024Boost Your NeRF: A Model-Agnostic Mixture of Experts Framework for High Quality and Efficient Rendering15 Jul
- 2022A Review of Sparse Expert Models in Deep Learning4 Sep
- 2021Scaling Vision with Sparse Mixture of Experts10 Jun
Other references · 46
- 2017Attention Is All You Needcited by 60,361
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
34 more
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
- 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 242
- 2022Memorizing Transformerscited by 226
- 2023WIRE: Wavelet Implicit Neural Representationscited by 220
- 2020DeRF: Decomposed Radiance Fieldscited by 163
- 2021NeRP: Implicit Neural Representation Learning with Prior Embedding for Sparsely Sampled Image Reconstructioncited by 146
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 145
- 2019Large Memory Layers with Product Keyscited by 124
- 2023DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecastingcited by 109
- 2023Operator Learning with Neural Fields: Tackling PDEs on General Geometriescited by 84
- 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 73
- 2021Dynamic CT Reconstruction from Limited Views with Implicit Neural Representations and Parametric Motion Fieldscited by 71
- 2025Geometry Aware Operator Transformer as an Efficient and Accurate Neural Surrogate for PDEs on Arbitrary Domainscited by 62
- 2022Improved Direct Voxel Grid Optimization for Radiance Fields Reconstructioncited by 61
- 2022CROM: Continuous Reduced-Order Modeling of PDEs Using Implicit Neural Representationscited by 58
- 2024CViT: Continuous Vision Transformer for Operator Learningcited by 51
- 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attentioncited by 38
- 2019InSituNet: Deep Image Synthesis for Parameter Space Exploration of Ensemble Simulationscited by 37
- 2021Spectral Bias in Practice: The Role of Function Frequency in Generalizationcited by 37
- 2022Neural Implicit Flow: a mesh-agnostic dimensionality reduction paradigm of spatio-temporal datacited by 37
- 2022Learning the Dynamics of Physical Systems from Sparse Observations with Finite Element Networkscited by 34
- 2022GNN-Surrogate: A Hierarchical and Adaptive Graph Neural Network for Parameter Space Exploration of Unstructured-Mesh Ocean Simulationscited by 32
- 2023ViTO: Vision Transformer-Operatorcited by 29
- 2024Aero-Nef: Neural Fields for Rapid Aircraft Aerodynamics Simulationscited by 24
- 2022VDL-Surrogate: A View-Dependent Latent-based Model for Parameter Space Exploration of Ensemble Simulationscited by 20
- 2024Continuous Field Reconstruction from Sparse Observations with Implicit Neural Networkscited by 20
- 2023Adaptively Placed Multi-Grid Scene Representation Networks for Large-Scale Data Visualizationcited by 16
- 2025Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Explorationcited by 8
- 2023INFINITY: Neural Field Modeling for Reynolds-Averaged Navier-Stokes Equationscited by 5
- 2024SurroFlow: A Flow-Based Surrogate Model for Parameter Space Exploration and Uncertainty Quantificationcited by 5
- 2022Linearizing Transformer with Key-Value Memorycited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026From Scalars to Time Series: Rethinking Implicit Neural Representations for Time-Varying Volumetric Data
- 2025A Review of Diffusion-based Simulation-Based Inference: Foundations and Applications in Non-Ideal Data Scenarios
- 2025P3D: Scalable Neural Surrogates for High-Resolution 3D Physics Simulations with Global Context
- 2026Adaptive recurrent flow map operator learning for reaction diffusion dynamics
- 2026Sparse probes and murky physics: a case study of interpretability challenges in a foundation model for continuum dynamics
- 2025Towards Foundational Models for Dynamical System Reconstruction: Hierarchical Meta-Learning via Mixture of Experts
- 2026Learning to Discretize: Diffusion-Based Adaptive Mesh with Spectral Guidance
- 2026How Architecture and Training Affect TPC Representations Across Experiments