Gradient-Based Optimization on G"odel Logic as Discrete Local Search
Not on the map. Why?
Abstract (arXiv)
A fundamental challenge in neurosymbolic systems is applying continuous gradient-based optimization to discrete logical domains. While fuzzy relaxations provide differentiability, they often lack a formal structural alignment with classical logic. In this work, we show that G"odel semantics addresses this limitation through a homomorphism that maps its continuous interpretations to Boolean ones, allowing discrete variables to be encoded while maintaining full differentiability. Building on this foundation, we show that gradient-based optimization on G"odel logic instantiates a discrete local search for Boolean satisfiability. Our formal analysis proves that each optimization step identifies and modifies a single variable within a unsatisfied clause, precisely mimicking the steps of a discrete solver. We identify local optima as the primary limitation of such dynamics and introduce the G"odel Trick, a stochastic reparameterization technique designed to improve the exploration of the solution space. We further show a formal connection between this approach, probabilistic inference, and the Gumbel-Max trick. Experimental results on SAT benchmarks and the Visual Sudoku task validate our theoretical findings, demonstrating that our approach effectively navigates complex combinatorial landscapes and provides a solid foundation for differentiable discrete search.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 15 of its 34 references that are in the map. First posted on arXiv 3 Mar 2025.
Builds on
15 of 34 references.
References · 15
- 2019Neural Probabilistic Logic Programming in DeepProbLogcited by 394
- 2019Monte Carlo Gradient Estimation in Machine Learningcited by 283
- 2017A Semantic Loss Function for Deep Learning with Symbolic Knowledgecited by 270
- 2018Learning a SAT Solver from Single-Bit Supervisioncited by 200
- 2019SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solvercited by 173
- 2022A-NeSI: A Scalable Approximate Method for Probabilistic Neurosymbolic Inferencecited by 50
- 2024BEARS Make Neuro-Symbolic Models Aware of their Reasoning Shortcutscited by 37
- 2022Deep Symbolic Learning: Discovering Symbols and Rules from Perceptionscited by 21
- 2022NSNet: A General Neural Probabilistic Framework for Satisfiability Problemscited by 18
- 2024On the Independence Assumption in Neurosymbolic Learningcited by 18
- 2023Logic of Differentiable Logics: Towards a Uniform Semantics of DLcited by 15
- 2024Mapping the Neuro-Symbolic AI Landscape by Architectures: A Handbook on Augmenting Deep Learning Through Symbolic Reasoningcited by 13
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.