mlsanityData to 7 Oct 2026

PIXEL: Physics-Informed Cell Representations for Fast and Accurate PDE Solvers

arXiv 2207.12800 ↗First posted 26 Jul 2022cs.LG cs.NA math.NAcited by 22

Not on the map. Why?

Abstract (arXiv)

With the increases in computational power and advances in machine learning, data-driven learning-based methods have gained significant attention in solving PDEs. Physics-informed neural networks (PINNs) have recently emerged and succeeded in various forward and inverse PDE problems thanks to their excellent properties, such as flexibility, mesh-free solutions, and unsupervised training. However, their slower convergence speed and relatively inaccurate solutions often limit their broader applicability in many science and engineering domains. This paper proposes a new kind of data-driven PDEs solver, physics-informed cell representations (PIXEL), elegantly combining classical numerical methods and learning-based approaches. We adopt a grid structure from the numerical methods to improve accuracy and convergence speed and overcome the spectral bias presented in PINNs. Moreover, the proposed method enjoys the same benefits in PINNs, e.g., using the same optimization frameworks to solve both forward and inverse PDE problems and readily enforcing PDE constraints with modern automatic differentiation techniques. We provide experimental results on various challenging PDEs that the original PINNs have struggled with and show that PIXEL achieves fast convergence speed and high accuracy. Project page: https://namgyukang.github.io/PIXEL/

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 49 of its 78 references that are in the map. First posted on arXiv 26 Jul 2022.

Builds on

49 of 78 references.

References · 49

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2017Mask R-CNNcited by 7,259
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  6. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  7. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
  8. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  9. 2015Fast R-CNNcited by 2,930
  10. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  11. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  12. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
37 more
  1. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  2. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  3. 2017Deformable Convolutional Networkscited by 1,481
  4. 2015Spatial Transformer Networkscited by 1,423
  5. 2018On the Spectral Bias of Neural Networkscited by 1,321
  6. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  7. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  8. 2015Automatic differentiation in machine learning: a surveycited by 846
  9. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  10. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  11. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  12. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  13. 2019DeepXDE: A deep learning library for solving differential equationscited by 617
  14. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
  15. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  16. 2021Neural Fields in Visual Computing and Beyondcited by 539
  17. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
  18. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  19. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  20. 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
  21. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
  22. 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 329
  23. 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
  24. 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
  25. 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 231
  26. 2019Informed Machine Learning -- A Taxonomy and Survey of Integrating Knowledge into Learning Systemscited by 203
  27. 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
  28. 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
  29. 2021Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equationscited by 142
  30. 2020Solving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural Networkscited by 122
  31. 2019PPINN: Parareal Physics-Informed Neural Network for time-dependent PDEscited by 116
  32. 2020Physics-informed neural network for ultrasound nondestructive quantification of surface breaking crackscited by 67
  33. 2022GO-Surf: Neural Feature Grid Optimization for Fast, High-Fidelity RGB-D Surface Reconstructioncited by 61
  34. 2020NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation frameworkcited by 58
  35. 2020A Dual-Dimer Method for Training Physics-Constrained Neural Networks with Minimax Architecturecited by 50
  36. 2022Nonlocal Kernel Network (NKN): a Stable and Resolution-Independent Deep Neural Networkcited by 45
  37. 2016Areas of Attention for Image Captioningcited by 23

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 9; 2025: 6; 2026: 5.

22 papers.

Sort:

By area:

  1. 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
  2. 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networkscited by 70
  3. 2025Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspectivecited by 55
  4. 2024PIG: Physics-Informed Gaussians as Adaptive Parametric Mesh Representationscited by 11
  5. 2024FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representationcited by 10
  6. 2025Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunitiescited by 10
  7. 2023RHINO: Regularizing the Hash-based Implicit Neural Representationcited by 9
  8. 2024Parametric Encoding with Attention and Convolution Mitigate Spectral Bias of Neural Partial Differential Equation Solverscited by 9
  9. 2025Continuous Representation Methods, Theories, and Applications: An Overview and Perspectivescited by 4
  10. 2024Solving Differential Equations with Constrained Learningcited by 3
  11. 2024Physics-Informed Autonomous LLM Agents for Explainable Power Electronics Modulation Designcited by 3
  12. 2025Enforcing hidden physics in physics-informed neural networkscited by 3
10 more
  1. 2024Towards the Spectral bias Alleviation by Normalizations in Coordinate Networkscited by 2
  2. 2024General-Kindred Physics-Informed Neural Network to the Solutions of Singularly Perturbed Differential Equationscited by 2
  3. 2025Compliance Minimization via Physics-Informed Gaussian Processescited by 2
  4. 2025Revisiting Heat Flux Analysis of Tungsten Monoblock Divertor on EAST using Physics-Informed Neural Networkcited by 2
  5. 2024Physics informed cell representations for variational formulation of multiscale problemscited by 1
  6. 2026Coordinate Encoding on Linear Grids for Physics-Informed Neural Networkscited by 0
  7. 2026Transferable Physics-Informed Representations via Closed-Form Head Adaptationcited by 0
  8. 2026PILIR: Physics-Informed Local Implicit Representationcited by 0
  9. 2026Hermite-NGP: Gradient-Augmented Hash Encoding for Learning PDEscited by 0
  10. 2026Texture-preserving implicit neural representation for Cone beam CT truncated reconstructioncited by 0