PIXEL: Physics-Informed Cell Representations for Fast and Accurate PDE Solvers
Not on the map. Why?
Abstract (arXiv)
With the increases in computational power and advances in machine learning, data-driven learning-based methods have gained significant attention in solving PDEs. Physics-informed neural networks (PINNs) have recently emerged and succeeded in various forward and inverse PDE problems thanks to their excellent properties, such as flexibility, mesh-free solutions, and unsupervised training. However, their slower convergence speed and relatively inaccurate solutions often limit their broader applicability in many science and engineering domains. This paper proposes a new kind of data-driven PDEs solver, physics-informed cell representations (PIXEL), elegantly combining classical numerical methods and learning-based approaches. We adopt a grid structure from the numerical methods to improve accuracy and convergence speed and overcome the spectral bias presented in PINNs. Moreover, the proposed method enjoys the same benefits in PINNs, e.g., using the same optimization frameworks to solve both forward and inverse PDE problems and readily enforcing PDE constraints with modern automatic differentiation techniques. We provide experimental results on various challenging PDEs that the original PINNs have struggled with and show that PIXEL achieves fast convergence speed and high accuracy. Project page: https://namgyukang.github.io/PIXEL/
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 49 of its 78 references that are in the map. First posted on arXiv 26 Jul 2022.
Builds on
49 of 78 references.
References · 49
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2017Mask R-CNNcited by 7,259
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2015Fast R-CNNcited by 2,930
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
37 more
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2017Deformable Convolutional Networkscited by 1,481
- 2015Spatial Transformer Networkscited by 1,423
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2015Automatic differentiation in machine learning: a surveycited by 846
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2019DeepXDE: A deep learning library for solving differential equationscited by 617
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
- 2017Solving high-dimensional partial differential equations using deep learningcited by 549
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
- 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 329
- 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
- 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
- 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 231
- 2019Informed Machine Learning -- A Taxonomy and Survey of Integrating Knowledge into Learning Systemscited by 203
- 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
- 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
- 2021Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equationscited by 142
- 2020Solving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural Networkscited by 122
- 2019PPINN: Parareal Physics-Informed Neural Network for time-dependent PDEscited by 116
- 2020Physics-informed neural network for ultrasound nondestructive quantification of surface breaking crackscited by 67
- 2022GO-Surf: Neural Feature Grid Optimization for Fast, High-Fidelity RGB-D Surface Reconstructioncited by 61
- 2020NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation frameworkcited by 58
- 2020A Dual-Dimer Method for Training Physics-Constrained Neural Networks with Minimax Architecturecited by 50
- 2022Nonlocal Kernel Network (NKN): a Stable and Resolution-Independent Deep Neural Networkcited by 45
- 2016Areas of Attention for Image Captioningcited by 23
Built on by
Citing papers per year: 2023: 2; 2024: 9; 2025: 6; 2026: 5.
22 papers.
Sort:
By area:
- 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
- 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networkscited by 70
- 2025Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspectivecited by 55
- 2024PIG: Physics-Informed Gaussians as Adaptive Parametric Mesh Representationscited by 11
- 2024FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representationcited by 10
- 2025Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunitiescited by 10
- 2023RHINO: Regularizing the Hash-based Implicit Neural Representationcited by 9
- 2024Parametric Encoding with Attention and Convolution Mitigate Spectral Bias of Neural Partial Differential Equation Solverscited by 9
- 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectivescited by 4
- 2024Solving Differential Equations with Constrained Learningcited by 3
- 2024Physics-Informed Autonomous LLM Agents for Explainable Power Electronics Modulation Designcited by 3
- 2025Enforcing hidden physics in physics-informed neural networkscited by 3
10 more
- 2024Towards the Spectral bias Alleviation by Normalizations in Coordinate Networkscited by 2
- 2024General-Kindred Physics-Informed Neural Network to the Solutions of Singularly Perturbed Differential Equationscited by 2
- 2025Compliance Minimization via Physics-Informed Gaussian Processescited by 2
- 2025Revisiting Heat Flux Analysis of Tungsten Monoblock Divertor on EAST using Physics-Informed Neural Networkcited by 2
- 2024Physics informed cell representations for variational formulation of multiscale problemscited by 1
- 2026Coordinate Encoding on Linear Grids for Physics-Informed Neural Networkscited by 0
- 2026Transferable Physics-Informed Representations via Closed-Form Head Adaptationcited by 0
- 2026PILIR: Physics-Informed Local Implicit Representationcited by 0
- 2026Hermite-NGP: Gradient-Augmented Hash Encoding for Learning PDEscited by 0
- 2026Texture-preserving implicit neural representation for Cone beam CT truncated reconstructioncited by 0
- 2026Texture-preserving implicit neural representation for Cone beam CT truncated reconstruction4 Jun 2026
- 2026Hermite-NGP: Gradient-Augmented Hash Encoding for Learning PDEs23 May 2026
- 2026PILIR: Physics-Informed Local Implicit Representation1 May 2026
- 2026Transferable Physics-Informed Representations via Closed-Form Head Adaptation23 Apr 2026
- 2026Coordinate Encoding on Linear Grids for Physics-Informed Neural Networks24 Mar 2026
- 2025Enforcing hidden physics in physics-informed neural networks18 Nov 2025
- 2025Revisiting Heat Flux Analysis of Tungsten Monoblock Divertor on EAST using Physics-Informed Neural Network5 Aug 2025
- 2025Compliance Minimization via Physics-Informed Gaussian Processes14 Jul 2025
- 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectives21 May 2025
- 2025Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspective2 Feb 2025
- 2025Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunities11 Jan 2025
- 2024PIG: Physics-Informed Gaussians as Adaptive Parametric Mesh Representations8 Dec 2024
10 more
- 2024Physics-Informed Autonomous LLM Agents for Explainable Power Electronics Modulation Design21 Nov 2024
- 2024Solving Differential Equations with Constrained Learning30 Oct 2024
- 2024General-Kindred Physics-Informed Neural Network to the Solutions of Singularly Perturbed Differential Equations27 Aug 2024
- 2024FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representation28 Jul 2024
- 2024Towards the Spectral bias Alleviation by Normalizations in Coordinate Networks25 Jul 2024
- 2024Physics informed cell representations for variational formulation of multiscale problems27 May 2024
- 2024Parametric Encoding with Attention and Convolution Mitigate Spectral Bias of Neural Partial Differential Equation Solvers22 Mar 2024
- 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networks1 Feb 2024
- 2023RHINO: Regularizing the Hash-based Implicit Neural Representation22 Sep 2023
- 2023An Expert's Guide to Training Physics-informed Neural Networks16 Aug 2023
- 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
- 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networkscited by 70
- 2025Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspectivecited by 55
- 2024PIG: Physics-Informed Gaussians as Adaptive Parametric Mesh Representationscited by 11
- 2024FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representationcited by 10
- 2025Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunitiescited by 10
- 2023RHINO: Regularizing the Hash-based Implicit Neural Representationcited by 9
- 2024Parametric Encoding with Attention and Convolution Mitigate Spectral Bias of Neural Partial Differential Equation Solverscited by 9
- 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectivescited by 4
- 2024Solving Differential Equations with Constrained Learningcited by 3
- 2025Enforcing hidden physics in physics-informed neural networkscited by 3
- 2024Towards the Spectral bias Alleviation by Normalizations in Coordinate Networkscited by 2
12 most cited of 21 All 21 (JSON)
- 2026Texture-preserving implicit neural representation for Cone beam CT truncated reconstruction4 Jun 2026
- 2026Hermite-NGP: Gradient-Augmented Hash Encoding for Learning PDEs23 May 2026
- 2026PILIR: Physics-Informed Local Implicit Representation1 May 2026
- 2026Transferable Physics-Informed Representations via Closed-Form Head Adaptation23 Apr 2026
- 2026Coordinate Encoding on Linear Grids for Physics-Informed Neural Networks24 Mar 2026
- 2025Enforcing hidden physics in physics-informed neural networks18 Nov 2025
- 2025Revisiting Heat Flux Analysis of Tungsten Monoblock Divertor on EAST using Physics-Informed Neural Network5 Aug 2025
- 2025Compliance Minimization via Physics-Informed Gaussian Processes14 Jul 2025
- 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectives21 May 2025
- 2025Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspective2 Feb 2025
- 2025Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunities11 Jan 2025
- 2024PIG: Physics-Informed Gaussians as Adaptive Parametric Mesh Representations8 Dec 2024
12 newest of 21 All 21 (JSON)