mlsanityData to 7 Oct 2026

Neural Network Emulator for Atmospheric Chemical ODE

arXiv 2408.01829 ↗First posted 3 Aug 2024cs.LG physics.ao-ph physics.chem-phcited by 5

Not on the map. Why?

Abstract (arXiv)

Modeling atmospheric chemistry is complex and computationally intense. Given the recent success of Deep neural networks in digital signal processing, we propose a Neural Network Emulator for fast chemical concentration modeling. We consider atmospheric chemistry as a time-dependent Ordinary Differential Equation. To extract the hidden correlations between initial states and future time evolution, we propose ChemNNE, an Attention based Neural Network Emulator (NNE) that can model the atmospheric chemistry as a neural ODE process. To efficiently simulate the chemical changes, we propose the sinusoidal time embedding to estimate the oscillating tendency over time. More importantly, we use the Fourier neural operator to model the ODE process for efficient computation. We also propose three physical-informed losses to supervise the training optimization. To evaluate our model, we propose a large-scale chemical dataset that can be used for neural network training and evaluation. The extensive experiments show that our approach achieves state-of-the-art performance in modeling accuracy and computational speed.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 28 of its 63 references that are in the map. First posted on arXiv 3 Aug 2024.

Builds on

28 of 63 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  4. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  5. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  6. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  7. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  8. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  9. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  10. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  11. 2019Release Strategies and the Social Impacts of Language Modelscited by 505
  12. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
16 more
  1. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
  2. 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
  3. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
  4. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
  5. 2020Dissecting Neural ODEscited by 150
  6. 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 144
  7. 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
  8. 2021Neural Flows: Efficient Alternative to Neural ODEscited by 99
  9. 2020MeshfreeFlowNet: A Physics-Constrained Deep Continuous Space-Time Super-Resolution Frameworkcited by 78
  10. 2020On Second Order Behaviour in Augmented Neural ODEscited by 68
  11. 2019Predicting materials properties without crystal structure: Deep representation learning from stoichiometrycited by 60
  12. 2023Learning stiff chemical kinetics using extended deep neural operatorscited by 30
  13. 2023A Unified Framework for U-Net Design and Analysiscited by 27
  14. 2020Self-Supervised Representation Learning for Astronomical Imagescited by 18
  15. 2023StylerDALLE: Language-Guided Style Transfer Using a Vector-Quantized Tokenizer of a Large-Scale Generative Modelcited by 10
  16. 2023DiffESM: Conditional Emulation of Earth System Models with Diffusion Modelscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

  1. 2025SPIN-ODE: Stiff Physics-Informed Neural ODE for Chemical Reaction Rate Estimationcited by 3
  2. 2026TopoFlow: Topography-aware Pollutant Flow Learning for High-Resolution Air Quality Predictioncited by 1
  3. 2026Inverse Neural Operator for ODE Parameter Optimizationcited by 1
  4. 2026MCMC Informed Neural Emulators for Uncertainty Quantification in Dynamical Systemscited by 0
  5. 2026Cross-Resolution Attention Network for High-Resolution PM2.5 Predictioncited by 0