Learning Interpretable Differentiable Logic Networks for Tabular Regression
Not on the map. Why?
Abstract (arXiv)
Neural networks (NNs) achieve outstanding performance in many domains; however, their decision processes are often opaque and their inference can be computationally expensive in resource-constrained environments. We recently proposed Differentiable Logic Networks (DLNs) to address these issues for tabular classification based on relaxing discrete logic into a differentiable form, thereby enabling gradient-based learning of networks built from binary logic operations. DLNs offer interpretable reasoning and substantially lower inference cost. We extend the DLN framework to supervised tabular regression. We first redesign the final output layer (the SumLayer) to support continuous targets. More critically, we find the original two-phase training procedure used for classification is suboptimal for regression, and thus develop a unified, single-stage optimization procedure. We also demonstrate that temperature annealing of the network's differentiable relaxations is decisive for achieving stable convergence and high accuracy. We evaluate the resulting model on 15 public regression benchmarks, comparing it with modern neural networks and classical regression baselines. Regression DLNs match or exceed baseline accuracy while preserving interpretability and fast inference. Our results show that DLNs are a viable, cost-effective alternative for regression tasks, especially where model transparency and computational efficiency are important.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 35 of its 56 references that are in the map. First posted on arXiv 29 May 2025.
Builds on
35 of 56 references.
References · 35
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,919
- 2015Automatic differentiation in machine learning: a surveycited by 855
23 more
- 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 849
- 2016Wide & Deep Learning for Recommender Systemscited by 747
- 2024KAN: Kolmogorov-Arnold Networkscited by 649
- 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 527
- 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 344
- 2023Atom: Low-bit Quantization for Efficient and Accurate LLM Servingcited by 272
- 2017Soft-DTW: a Differentiable Loss Function for Time-Seriescited by 271
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 258
- 2017Distilling a Neural Network Into a Soft Decision Treecited by 236
- 2019Neural Oblivious Decision Ensembles for Deep Learning on Tabular Datacited by 203
- 2016FINN: A Framework for Fast, Scalable Binarized Neural Network Inferencecited by 150
- 2019Neural Logic Machinescited by 145
- 2020Logical Neural Networkscited by 119
- 2020Generalized and Scalable Optimal Sparse Decision Treescited by 100
- 2015Supersparse Linear Integer Models for Optimized Medical Scoring Systemscited by 76
- 2018Deep Neural Decision Treescited by 72
- 2022Deep Differentiable Logic Gate Networkscited by 67
- 2018Adaptive Neural Treescited by 64
- 2021Scalable Rule-Based Representation Learning for Interpretable Classificationcited by 40
- 2024Convolutional Differentiable Logic Gate Networkscited by 37
- 2022Learning with Differentiable Algorithmscited by 10
- 2024Learning Interpretable Differentiable Logic Networkscited by 10
- 2019Neural Logic Networkscited by 7
Built on by
Citing papers per year: 2025: 2.
2 papers.