Integration of knowledge and data in machine learning
Not on the map. Why?
Abstract (arXiv)
Scientific research's mandate is to comprehend and explore the world, as well as to improve it based on experience and knowledge. Knowledge embedding and knowledge discovery are two significant methods of integrating knowledge and data. Through knowledge embedding, the barriers between knowledge and data can be eliminated, and machine learning models with physical common sense can be established. Meanwhile, humans' understanding of the world is always limited, and knowledge discovery takes advantage of machine learning to extract new knowledge from observations. Knowledge discovery can not only assist researchers to better grasp the nature of physics, but it can also support them in conducting knowledge embedding research. A closed loop of knowledge generation and usage are formed by combining knowledge embedding with knowledge discovery, which can improve the robustness and accuracy of models and uncover previously unknown scientific principles. This study summarizes and analyzes extant literature, as well as identifies research gaps and future opportunities.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 25 of its 74 references that are in the map. First posted on arXiv 15 Feb 2022.
Builds on
25 of 74 references.
References · 25
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,067
- 2014Distributed Representations of Sentences and Documentscited by 677
- 2017PDE-Net: Learning PDEs from Datacited by 304
- 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
- 2018PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Networkcited by 208
- 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
- 2016Theory-guided Data Science: A New Paradigm for Scientific Discovery from Datacited by 169
- 2020Physics-informed learning of governing equations from scarce datacited by 167
- 2018Learning Equations for Extrapolation and Controlcited by 151
- 2017Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modelingcited by 130
- 2015Constrained Convolutional Neural Networks for Weakly Supervised Segmentationcited by 100
13 more
- 2018Reinforcement Learning of Theorem Provingcited by 69
- 2020DLGA-PDE: Discovery of PDEs with incomplete candidate library via combination of deep learning and genetic algorithmcited by 45
- 2021Any equation is a forest: Symbolic genetic algorithm for discovering open-form partial differential equations (SGA-PDE)cited by 38
- 2019Deep Learning of Subsurface Flow via Theory-guided Neural Networkcited by 32
- 2020Theory-guided hard constraint projection (HCP): a knowledge-based data-driven scientific machine learning methodcited by 29
- 2022Discovering Nonlinear PDEs from Scarce Data with Physics-encoded Learningcited by 24
- 2021Robust discovery of partial differential equations in complex situationscited by 21
- 2020Deep-learning of Parametric Partial Differential Equations from Sparse and Noisy Datacited by 19
- 2020Efficient Uncertainty Quantification for Dynamic Subsurface Flow with Surrogate by Theory-guided Neural Networkcited by 17
- 2020Deep-learning based discovery of partial differential equations in integral form from sparse and noisy datacited by 14
- 2018Identification of physical processes via combined data-driven and data-assimilation methodscited by 4
- 2017Saliency Preservation in Low-Resolution Grayscale Imagescited by 2
- 2021Discovering PDEs from Multiple Experimentscited by 2
Built on by
Citing papers per year: 2022: 5; 2023: 4; 2024: 4.
13 papers.
Sort:
- 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 97
- 2024LLM4ED: Large Language Models for Automatic Equation Discoverycited by 13
- 2022Discrete Point-wise Attack Is Not Enough: Generalized Manifold Adversarial Attack for Face Recognitioncited by 11
- 2022AutoKE: An automatic knowledge embedding framework for scientific machine learningcited by 6
- 2022DISCOVER: Deep identification of symbolically concise open-form PDEs via enhanced reinforcement-learningcited by 3
- 2023Depression Detection Using Digital Traces on Social Media: A Knowledge-aware Deep Learning Approachcited by 3
- 2024A Data-Driven Framework for Discovering Fractional Differential Equations in Complex Systemscited by 3
- 2022TgDLF2.0: Theory-guided deep-learning for electrical load forecasting via Transformer and transfer learningcited by 2
- 2024Discovering an interpretable mathematical expression for a full wind-turbine wake with artificial intelligence enhanced symbolic regressioncited by 2
- 2022Knowledge-Injected Federated Learningcited by 1
- 2023Filtered Partial Differential Equations: a robust surrogate constraint in physics-informed deep learning frameworkcited by 1
- 2023Transforming organic chemistry research paradigms: moving from manual efforts to the intersection of automation and artificial intelligencecited by 0
- 2024A Data-Driven Framework for Discovering Fractional Differential Equations in Complex Systems5 Dec 2024
- 2024A Noise-robust Multi-head Attention Mechanism for Formation Resistivity Prediction: Frequency Aware LSTM6 Jun 2024
- 2024Discovering an interpretable mathematical expression for a full wind-turbine wake with artificial intelligence enhanced symbolic regression2 Jun 2024
- 2024LLM4ED: Large Language Models for Automatic Equation Discovery13 May 2024
- 2023Transforming organic chemistry research paradigms: moving from manual efforts to the intersection of automation and artificial intelligence26 Nov 2023
- 2023Filtered Partial Differential Equations: a robust surrogate constraint in physics-informed deep learning framework7 Nov 2023
- 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects16 Jun 2023
- 2023Depression Detection Using Digital Traces on Social Media: A Knowledge-aware Deep Learning Approach6 Mar 2023
- 2022Discrete Point-wise Attack Is Not Enough: Generalized Manifold Adversarial Attack for Face Recognition19 Dec 2022
- 2022TgDLF2.0: Theory-guided deep-learning for electrical load forecasting via Transformer and transfer learning5 Oct 2022
- 2022DISCOVER: Deep identification of symbolically concise open-form PDEs via enhanced reinforcement-learning4 Oct 2022
- 2022Knowledge-Injected Federated Learning16 Aug 2022
1 more
- 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 97
- 2024LLM4ED: Large Language Models for Automatic Equation Discoverycited by 13
- 2022Discrete Point-wise Attack Is Not Enough: Generalized Manifold Adversarial Attack for Face Recognitioncited by 11
- 2022AutoKE: An automatic knowledge embedding framework for scientific machine learningcited by 6
- 2022DISCOVER: Deep identification of symbolically concise open-form PDEs via enhanced reinforcement-learningcited by 3
- 2023Depression Detection Using Digital Traces on Social Media: A Knowledge-aware Deep Learning Approachcited by 3
- 2024A Data-Driven Framework for Discovering Fractional Differential Equations in Complex Systemscited by 3
- 2022TgDLF2.0: Theory-guided deep-learning for electrical load forecasting via Transformer and transfer learningcited by 2
- 2024Discovering an interpretable mathematical expression for a full wind-turbine wake with artificial intelligence enhanced symbolic regressioncited by 2
- 2022Knowledge-Injected Federated Learningcited by 1
- 2023Filtered Partial Differential Equations: a robust surrogate constraint in physics-informed deep learning frameworkcited by 1
- 2023Transforming organic chemistry research paradigms: moving from manual efforts to the intersection of automation and artificial intelligencecited by 0
12 most cited of 13 All 13 (JSON)
- 2024A Data-Driven Framework for Discovering Fractional Differential Equations in Complex Systems5 Dec 2024
- 2024A Noise-robust Multi-head Attention Mechanism for Formation Resistivity Prediction: Frequency Aware LSTM6 Jun 2024
- 2024Discovering an interpretable mathematical expression for a full wind-turbine wake with artificial intelligence enhanced symbolic regression2 Jun 2024
- 2024LLM4ED: Large Language Models for Automatic Equation Discovery13 May 2024
- 2023Transforming organic chemistry research paradigms: moving from manual efforts to the intersection of automation and artificial intelligence26 Nov 2023
- 2023Filtered Partial Differential Equations: a robust surrogate constraint in physics-informed deep learning framework7 Nov 2023
- 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects16 Jun 2023
- 2023Depression Detection Using Digital Traces on Social Media: A Knowledge-aware Deep Learning Approach6 Mar 2023
- 2022Discrete Point-wise Attack Is Not Enough: Generalized Manifold Adversarial Attack for Face Recognition19 Dec 2022
- 2022TgDLF2.0: Theory-guided deep-learning for electrical load forecasting via Transformer and transfer learning5 Oct 2022
- 2022DISCOVER: Deep identification of symbolically concise open-form PDEs via enhanced reinforcement-learning4 Oct 2022
- 2022Knowledge-Injected Federated Learning16 Aug 2022
12 newest of 13 All 13 (JSON)