Neural Electromagnetic Fields for High-Resolution Material Parameter Reconstruction
Not on the map. Why?
Abstract (arXiv)
Creating functional Digital Twins, simulatable 3D replicas of the real world, is a central challenge in computer vision. Current methods like NeRF produce visually rich but functionally incomplete twins. The key barrier is the lack of underlying material properties (e.g., permittivity, conductivity). Acquiring this information for every point in a scene via non-contact, non-invasive sensing is a primary goal, but it demands solving a notoriously ill-posed physical inversion problem. Standard remote signals, like images and radio frequencies (RF), deeply entangle the unknown geometry, ambient field, and target materials. We introduce NEMF, a novel framework for dense, non-invasive physical inversion designed to build functional digital twins. Our key insight is a systematic disentanglement strategy. NEMF leverages high-fidelity geometry from images as a powerful anchor, which first enables the resolution of the ambient field. By constraining both geometry and field using only non-invasive data, the original ill-posed problem transforms into a well-posed, physics-supervised learning task. This transformation unlocks our core inversion module: a decoder. Guided by ambient RF signals and a differentiable layer incorporating physical reflection models, it learns to explicitly output a continuous, spatially-varying field of the scene's underlying material parameters. We validate our framework on high-fidelity synthetic datasets. Experiments show our non-invasive inversion reconstructs these material maps with high accuracy, and the resulting functional twin enables high-fidelity physical simulation. This advance moves beyond passive visual replicas, enabling the creation of truly functional and simulatable models of the physical world.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 43 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
23 of 43 references.
References · 23
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
- 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
- 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
- 2023On the Road to 6G: Visions, Requirements, Key Technologies and Testbedscited by 77
11 more
- 2023NeRF2: Neural Radio-Frequency Radiance Fieldscited by 57
- 2024NeWRF: A Deep Learning Framework for Wireless Radiation Field Reconstruction and Channel Predictioncited by 28
- 2024RF-3DGS: Wireless Channel Modeling with Radio Radiance Field and 3D Gaussian Splattingcited by 20
- 2021Inverse deep learning methods and benchmarks for artificial electromagnetic material designcited by 10
- 2024Radio Frequency Ray Tracing with Neural Object Representationcited by 10
- 2024ChannelGPT: A Large Model to Generate Digital Twin Channel for 6G Environment Intelligencecited by 8
- 2024BostonTwin: the Boston Digital Twin for Ray-Tracing in 6G Networkscited by 6
- 2025Network Digital Twin for 6G and Beyond: An End-to-End View Across Multi-Domain Network Ecosystemscited by 5
- 2023Towards 6G Digital Twin Channel Using Radio Environment Knowledge Poolcited by 1
- 2025High-Fidelity RF Mapping: Assessing Environmental Modeling in 6G Network Digital Twinscited by 1
- 2025A Differentiable Framework for Full and Phaseless Data Inversion Using Neural Implicit Contrast-Source Representationcited by 1
Built on by
Not cited yet.