mlsanityData to 14 Oct 2026

FA-INR: Adaptive Implicit Neural Representations for Interpretable Exploration of Simulation Ensembles

arXiv 2506.06858 ↗First posted 7 Jun 2025cs.LG cs.AIcited by 1

On the map: Mixture-of-experts → Vision mixture-of-experts

Abstract (arXiv)

Surrogate models are essential for efficient exploration of large-scale ensemble simulations. Implicit neural representations (INRs) provide a compact and continuous framework for modeling spatially structured data, but they often struggle with learning complex localized structures within the scientific fields. Recent INR-based surrogates address this by augmenting INRs with explicit feature structures, but at the cost of flexibility and substantial memory overhead. In this paper, we present Feature-Adaptive INR (FA-INR), an adaptive INR-based surrogate model for high-fidelity and interpretable exploration of ensemble simulations. Instead of relying on structured feature representations, FA-INR leverages cross-attention over a learnable key-value memory bank to allocate model capacity adaptively based on the data characteristics. To further improve scalability, we introduce a coordinate-guided mixture of experts (MoE) framework that enhances both efficiency and specialization of feature representations. More importantly, the learned experts produce an interpretable partition over the simulation domain, enabling scientists to identify complex structures and perform localized parameter-space exploration. Beyond quantitative and qualitative evaluations, we also demonstrate that our learned expert specialization can reveal meaningful scientific insights and support localized sensitivity analysis.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Vision mixture-of-experts, one of 12 directions in Mixture-of-experts. Builds on 50 of its 65 references that are in the map. First posted on arXiv 7 Jun 2025.

Builds on

50 of 65 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024Neural Experts: Mixture of Experts for Implicit Neural Representations29 Oct
  2. 2024Boost Your NeRF: A Model-Agnostic Mixture of Experts Framework for High Quality and Efficient Rendering15 Jul
  3. 2022A Review of Sparse Expert Models in Deep Learning4 Sep
  4. 2021Scaling Vision with Sparse Mixture of Experts10 Jun

Other references · 46

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  3. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  4. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  5. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  6. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  7. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  8. 2018On the Spectral Bias of Neural Networkscited by 1,341
  9. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  10. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  11. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
  12. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
34 more
  1. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  2. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  3. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
  4. 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
  5. 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 242
  6. 2022Memorizing Transformerscited by 226
  7. 2023WIRE: Wavelet Implicit Neural Representationscited by 220
  8. 2020DeRF: Decomposed Radiance Fieldscited by 163
  9. 2021NeRP: Implicit Neural Representation Learning with Prior Embedding for Sparsely Sampled Image Reconstructioncited by 146
  10. 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 145
  11. 2019Large Memory Layers with Product Keyscited by 124
  12. 2023DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecastingcited by 109
  13. 2023Operator Learning with Neural Fields: Tackling PDEs on General Geometriescited by 84
  14. 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 73
  15. 2021Dynamic CT Reconstruction from Limited Views with Implicit Neural Representations and Parametric Motion Fieldscited by 71
  16. 2025Geometry Aware Operator Transformer as an Efficient and Accurate Neural Surrogate for PDEs on Arbitrary Domainscited by 62
  17. 2022Improved Direct Voxel Grid Optimization for Radiance Fields Reconstructioncited by 61
  18. 2022CROM: Continuous Reduced-Order Modeling of PDEs Using Implicit Neural Representationscited by 58
  19. 2024CViT: Continuous Vision Transformer for Operator Learningcited by 51
  20. 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attentioncited by 38
  21. 2019InSituNet: Deep Image Synthesis for Parameter Space Exploration of Ensemble Simulationscited by 37
  22. 2021Spectral Bias in Practice: The Role of Function Frequency in Generalizationcited by 37
  23. 2022Neural Implicit Flow: a mesh-agnostic dimensionality reduction paradigm of spatio-temporal datacited by 37
  24. 2022Learning the Dynamics of Physical Systems from Sparse Observations with Finite Element Networkscited by 34
  25. 2022GNN-Surrogate: A Hierarchical and Adaptive Graph Neural Network for Parameter Space Exploration of Unstructured-Mesh Ocean Simulationscited by 32
  26. 2023ViTO: Vision Transformer-Operatorcited by 29
  27. 2024Aero-Nef: Neural Fields for Rapid Aircraft Aerodynamics Simulationscited by 24
  28. 2022VDL-Surrogate: A View-Dependent Latent-based Model for Parameter Space Exploration of Ensemble Simulationscited by 20
  29. 2024Continuous Field Reconstruction from Sparse Observations with Implicit Neural Networkscited by 20
  30. 2023Adaptively Placed Multi-Grid Scene Representation Networks for Large-Scale Data Visualizationcited by 16
  31. 2025Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Explorationcited by 8
  32. 2023INFINITY: Neural Field Modeling for Reynolds-Averaged Navier-Stokes Equationscited by 5
  33. 2024SurroFlow: A Flow-Based Surrogate Model for Parameter Space Exploration and Uncertainty Quantificationcited by 5
  34. 2022Linearizing Transformer with Key-Value Memorycited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Scalars to Time Series: Rethinking Implicit Neural Representations for Time-Varying Volumetric Data
  2. 2025A Review of Diffusion-based Simulation-Based Inference: Foundations and Applications in Non-Ideal Data Scenarios
  3. 2025P3D: Scalable Neural Surrogates for High-Resolution 3D Physics Simulations with Global Context
  4. 2026Adaptive recurrent flow map operator learning for reaction diffusion dynamics
  5. 2026Sparse probes and murky physics: a case study of interpretability challenges in a foundation model for continuum dynamics
  6. 2025Towards Foundational Models for Dynamical System Reconstruction: Hierarchical Meta-Learning via Mixture of Experts
  7. 2026Learning to Discretize: Diffusion-Based Adaptive Mesh with Spectral Guidance
  8. 2026How Architecture and Training Affect TPC Representations Across Experiments