mlsanityData to 7 Oct 2026

DN-CL: Deep Symbolic Regression against Noise via Contrastive Learning

arXiv 2406.14844 ↗First posted 21 Jun 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Noise ubiquitously exists in signals due to numerous factors including physical, electronic, and environmental effects. Traditional methods of symbolic regression, such as genetic programming or deep learning models, aim to find the most fitting expressions for these signals. However, these methods often overlook the noise present in real-world data, leading to reduced fitting accuracy. To tackle this issue, we propose textitDeep Symbolic Regression against Noise via Contrastive Learning (DN-CL). DN-CL employs two parameter-sharing encoders to embed data points from various data transformations into feature shields against noise. This model treats noisy data and clean data as different views of the ground-truth mathematical expressions. Distances between these features are minimized, utilizing contrastive learning to distinguish between 'positive' noise-corrected pairs and 'negative' contrasting pairs. Our experiments indicate that DN-CL demonstrates superior performance in handling both noisy and clean data, presenting a promising method of symbolic regression.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 36 references that are in the map. First posted on arXiv 21 Jun 2024.

Builds on

20 of 36 references.

References · 20

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  4. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
  5. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
  6. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
  7. 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 294
  8. 2021Contemporary Symbolic Regression Methods and their Relative Performancecited by 209
  9. 2022End-to-end symbolic regression with transformerscited by 195
  10. 2021Neural Symbolic Regression that Scalescited by 185
  11. 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 140
  12. 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 101
8 more
  1. 2021Symbolic Regression via Neural-Guided Genetic Programming Population Seedingcited by 97
  2. 2019Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discoverycited by 93
  3. 2023Transformer-based Planning for Symbolic Regressioncited by 72
  4. 2022SymFormer: End-to-end symbolic regression using transformer-based architecturecited by 56
  5. 2023SNIP: Bridging Mathematical Symbolic and Numeric Realms with Unified Pre-trainingcited by 41
  6. 2023Deep Generative Symbolic Regressioncited by 27
  7. 2023Controllable Neural Symbolic Regressioncited by 19
  8. 2024MMSR: Symbolic Regression is a Multi-Modal Information Fusion Taskcited by 13

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.