DN-CL: Deep Symbolic Regression against Noise via Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Noise ubiquitously exists in signals due to numerous factors including physical, electronic, and environmental effects. Traditional methods of symbolic regression, such as genetic programming or deep learning models, aim to find the most fitting expressions for these signals. However, these methods often overlook the noise present in real-world data, leading to reduced fitting accuracy. To tackle this issue, we propose textitDeep Symbolic Regression against Noise via Contrastive Learning (DN-CL). DN-CL employs two parameter-sharing encoders to embed data points from various data transformations into feature shields against noise. This model treats noisy data and clean data as different views of the ground-truth mathematical expressions. Distances between these features are minimized, utilizing contrastive learning to distinguish between 'positive' noise-corrected pairs and 'negative' contrasting pairs. Our experiments indicate that DN-CL demonstrates superior performance in handling both noisy and clean data, presenting a promising method of symbolic regression.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 36 references that are in the map. First posted on arXiv 21 Jun 2024.
Builds on
20 of 36 references.
References · 20
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 294
- 2021Contemporary Symbolic Regression Methods and their Relative Performancecited by 209
- 2022End-to-end symbolic regression with transformerscited by 195
- 2021Neural Symbolic Regression that Scalescited by 185
- 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 140
- 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 101
8 more
- 2021Symbolic Regression via Neural-Guided Genetic Programming Population Seedingcited by 97
- 2019Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discoverycited by 93
- 2023Transformer-based Planning for Symbolic Regressioncited by 72
- 2022SymFormer: End-to-end symbolic regression using transformer-based architecturecited by 56
- 2023SNIP: Bridging Mathematical Symbolic and Numeric Realms with Unified Pre-trainingcited by 41
- 2023Deep Generative Symbolic Regressioncited by 27
- 2023Controllable Neural Symbolic Regressioncited by 19
- 2024MMSR: Symbolic Regression is a Multi-Modal Information Fusion Taskcited by 13
Built on by
Citing papers per year: 2025: 1.
1 paper.