mlsanityData to 7 Oct 2026

Shape Arithmetic Expressions: Advancing Scientific Discovery Beyond Closed-Form Equations

arXiv 2404.09788 ↗First posted 15 Apr 2024cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Symbolic regression has excelled in uncovering equations from physics, chemistry, biology, and related disciplines. However, its effectiveness becomes less certain when applied to experimental data lacking inherent closed-form expressions. Empirically derived relationships, such as entire stress-strain curves, may defy concise closed-form representation, compelling us to explore more adaptive modeling approaches that balance flexibility with interpretability. In our pursuit, we turn to Generalized Additive Models (GAMs), a widely used class of models known for their versatility across various domains. Although GAMs can capture non-linear relationships between variables and targets, they cannot capture intricate feature interactions. In this work, we investigate both of these challenges and propose a novel class of models, Shape Arithmetic Expressions (SHAREs), that fuses GAM's flexible shape functions with the complex feature interactions found in mathematical expressions. SHAREs also provide a unifying framework for both of these approaches. We also design a set of rules for constructing SHAREs that guarantee transparency of the found expressions beyond the standard constraints based on the model's size.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 64 references that are in the map. First posted on arXiv 15 Apr 2024.

Builds on

24 of 64 references.

References · 24

  1. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  2. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  3. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  4. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
  5. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
  6. 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
  7. 2020Neural Additive Models: Interpretable Machine Learning with Neural Netscited by 318
  8. 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 294
  9. 2020Neurosymbolic AI: The 3rd Wavecited by 253
  10. 2019InterpretML: A Unified Framework for Machine Learning Interpretabilitycited by 243
  11. 2022End-to-end symbolic regression with transformerscited by 195
  12. 2021Neural Symbolic Regression that Scalescited by 185
12 more
  1. 2018Learning Equations for Extrapolation and Controlcited by 151
  2. 2020A Survey on Evolutionary Neural Architecture Searchcited by 142
  3. 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 140
  4. 2017PMLB: A Large Benchmark Suite for Machine Learning Evaluation and Comparisoncited by 139
  5. 2016Extrapolation and learning equationscited by 106
  6. 2021NODE-GAM: Neural Generalized Additive Model for Interpretable Deep Learningcited by 88
  7. 2022Symbolic Regression is NP-hardcited by 68
  8. 2022Neural Basis Models for Interpretabilitycited by 56
  9. 2018HOUDINI: Lifelong Learning as Program Synthesiscited by 38
  10. 2019Control Regularization for Reduced Variance Reinforcement Learningcited by 34
  11. 2023Deep Generative Symbolic Regressioncited by 27
  12. 2021Complexity Measures for Multi-objective Symbolic Regressioncited by 11

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.