Lukasiewicz Neural Networks Extended: Residual Architectures and Crystallization Strategies for Interpretable Rule Extraction
Not on the map. Why?
Abstract (arXiv)
A feed-forward neural network whose weights are integers and whose activation is the truncated identity implements, neuron by neuron, the connectives of Lukasiewicz many-valued logic. This exact correspondence --- established theoretically by Castro and Trillas and developed into a training algorithm by Leandro --- enables symbolic knowledge extraction: training produces not a black-box model but a logical formula. Two obstacles have limited the approach to shallow architectures and small datasets: crystallization (forcing weights to integers) succeeds only probabilistically under the original Levenberg--Marquardt training scheme, and the theoretical guarantees break down as networks grow deeper. This paper addresses both obstacles. First, we prove that residual connections (skip connections of the kind used in ResNets) extend Lukasiewicz neural networks to arbitrary depth while preserving the symbolic correspondence at merge neurons by construction: merge neurons in a Lukasiewicz residual block automatically satisfy the neuron-classification proposition, regardless of the inner layer weights; inner-layer neurons are trained toward representability by the crystallization strategy. Second, we analyse three crystallization strategies --- Levenberg--Marquardt (corrected), straight-through estimation (STE), and proximal regularization --- characterizing their theoretical guarantees, failure modes, and interpretability trade-offs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 30 references that are in the map. First posted on arXiv 26 Sep 2026.
Builds on
11 of 30 references.
References · 11
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2019Neural Probabilistic Logic Programming in DeepProbLogcited by 394
- 2020Neurosymbolic AI: The 3rd Wavecited by 255
- 2017Learning Explanatory Rules from Noisy Datacited by 211
- 2016Ternary Weight Networkscited by 204
- 2019Neural-Symbolic Computing: An Effective Methodology for Principled Integration of Machine Learning and Reasoningcited by 151
- 2020Logical Neural Networkscited by 119
- 2016Symbolic Knowledge Extraction using Lukasiewicz Logicscited by 1
Built on by
Not cited yet.