SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solver
Not on the map. Why?
Cited by 34 in LLM reasoning, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Integrating logical reasoning within deep learning architectures has been a major goal of modern AI systems. In this paper, we propose a new direction toward this goal by introducing a differentiable (smoothed) maximum satisfiability (MAXSAT) solver that can be integrated into the loop of larger deep learning systems. Our (approximate) solver is based upon a fast coordinate descent approach to solving the semidefinite program (SDP) associated with the MAXSAT problem. We show how to analytically differentiate through the solution to this SDP and efficiently solve the associated backward pass. We demonstrate that by integrating this solver into end-to-end learning systems, we can learn the logical structure of challenging problems in a minimally supervised fashion. In particular, we show that we can learn the parity function using single-bit supervision (a traditionally hard task for deep networks) and learn how to play 9x9 Sudoku solely from examples. We also solve a "visual Sudok" problem that maps images of Sudoku puzzles to their associated logical solutions by combining our MAXSAT solver with a traditional convolutional architecture. Our approach thus shows promise in integrating logical structures within deep learning.
Key facts. Cited by 173 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 31; 2023: 33; 2024: 26; 2025: 25; 2026: 31.
173 papers.
Sort:
By area:
- 2021Implicit Behavioral Cloningcited by 442
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
- 2021DC3: A learning method for optimization with hard constraintscited by 181
- 2021End-to-End Constrained Optimization Learning: A Surveycited by 154
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
- 2021Implicit MLE: Backpropagating Through Discrete Exponential Family Distributionscited by 97
- 2022On the Paradox of Learning to Reason from Datacited by 93
- 2021On Training Implicit Modelscited by 73
- 2023Dirichlet Diffusion Score Model for Biological Sequence Generationcited by 73
- 2023Scallop: A Language for Neurosymbolic Programmingcited by 63
- 2021Neuro-Symbolic Artificial Intelligence: Current Trendscited by 54
- 2021CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraintscited by 49
38 more
- 2022Deep Equilibrium Approaches to Diffusion Modelscited by 42
- 2022Sub-Task Decomposition Enables Learning in Sequence to Sequence Taskscited by 41
- 2022Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matricescited by 37
- 2024Artificial Kuramoto Oscillatory Neuronscited by 37
- 2024Learning Iterative Reasoning through Energy Diffusioncited by 36
- 2021From Machine Learning to Robotics: Challenges and Opportunities for Embodied Intelligencecited by 35
- 2022NeuPSL: Neural Probabilistic Soft Logiccited by 34
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 34
- 2021Enforcing Policy Feasibility Constraints through Differentiable Projection for Energy Optimizationcited by 31
- 2022Backpropagation through Combinatorial Algorithms: Identity with Projection Workscited by 29
- 2021Implicit Normalizing Flowscited by 28
- 2021Constraint-based graph network simulatorcited by 27
- 2022Beyond backpropagation: bilevel optimization through implicit differentiation and equilibrium propagationcited by 26
- 2023Recurrence without Recurrence: Stable Video Landmark Detection with Deep Equilibrium Modelscited by 26
- 2021Techniques for Symbol Grounding with SATNetcited by 24
- 2022Alternating Differentiation for Optimization Layerscited by 22
- 2023LION: Implicit Vision Prompt Tuningcited by 22
- 2022SurCo: Learning Linear Surrogates For Combinatorial Nonlinear Optimization Problemscited by 21
- 2023Learning to Solve Constraint Satisfaction Problems with Recurrent Transformercited by 21
- 2023A Pseudo-Semantic Loss for Autoregressive Models with Logical Constraintscited by 21
- 2022Deep Symbolic Learning: Discovering Symbols and Rules from Perceptionscited by 20
- 2021A global convergence theory for deep ReLU implicit networks via over-parameterizationcited by 17
- 2023Landscape Surrogate: Learning Decision Losses for Mathematical Optimization Under Partial Informationcited by 17
- 2024Softened Symbol Grounding for Neuro-symbolic Systemscited by 16
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomycited by 16
- 2024LinSATNet: The Positive Linear Satisfiability Neural Networkscited by 16
- 2021Joint inference and input optimization in equilibrium networkscited by 15
- 2022The Curse of Unrolling: Rate of Differentiating Through Optimizationcited by 15
- 2022Neural Set Function Extensions: Learning with Discrete Functions in High Dimensionscited by 14
- 2023On Learning Latent Models with Multi-Instance Weak Supervisioncited by 13
- 2025Shortcuts and Identifiability in Concept-based Models from a Neuro-Symbolic Lenscited by 13
- 2026ToolGate: Contract-Grounded and Verified Tool Execution for LLMscited by 13
- 2022Certifiable 3D Object Pose Estimation: Foundations, Learning Models, and Self-Trainingcited by 12
- 2022Adaptive Perturbation-Based Gradient Estimation for Discrete Latent Variable Modelscited by 12
- 2023Semantic Strengthening of Neuro-Symbolic Learningcited by 12
- 2023Injecting Logical Constraints into Neural Networks via Straight-Through Estimatorscited by 12
- 2024Neuro-symbolic Learning Yielding Logical Constraintscited by 12
- 2021Neuro-algorithmic Policies enable Fast Combinatorial Generalizationcited by 11
50 most cited of 173 All 173 (JSON)
- 2026Reasoning with Neural Cellular Automata28 Sep 2026
- 2026The Geometry of Logic: Stratification Induces Semantic Structure and Robust Reasoning26 Sep 2026
- 2026XLOG: A CUDA-Native Engine for Neurosymbolic Integration23 Sep 2026
- 2026When Recursive Models Finish Computing22 Sep 2026
- 2026Soft Symbol Grounding for Prototypical Concepts10 Sep 2026
- 2026Let It Go or Learn to Self-Correct: Continuous Diffusion for Constrained Discrete Tasks8 Sep 2026
- 2026DualCert: A Solver for the Traveling Salesman Problem with Constraint-Coupled Learning10 Aug 2026
- 2026Anatomy of a Sound Neural Reasoner: One-Shot Amortization, First-Pass Poisoning, and Search Inertness in Clue-Rich Completion22 Jul 2026
- 2026G-RRM: Guiding Symbolic Solvers with Recurrent Reasoning Models2 Jul 2026
- 2026Neural Certificate Pricing for Combinatorial Optimization Problems1 Jul 2026
- 2026Retrieval-Warmed Energy-Based Reasoning: A Five-Arm Ablation Methodology for Diffusion-as-Inference on Structured Reasoning Tasks25 Jun 2026
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraints5 Jun 2026
38 more
- 2026Diff2SP: Diffusion Models for Correlated Scenario Generation in Stochastic Programming4 Jun 2026
- 2026Position: Certified Correctness in Neural Constraint Reasoning Requires Symbolic Integration2 Jun 2026
- 2026DisjunctiveNet: Neural Symbolic Learning via Differentiable Convexified Optimization Layers28 May 2026
- 2026Blocked Gibbs meets Diffusion Transformers: Unsupervised Learning for Constraint Optimization24 May 2026
- 2026Winfree Oscillatory Neural Network20 May 2026
- 2026Streamlined Constraint Reasoning via CNN Pattern Recognition on Enumerated Solutions19 May 2026
- 2026Constraint-Aware Flow Matching: Decision Aligned End-to-End Training for Constrained Sampling12 May 2026
- 2026Lattice Deduction Transformers9 May 2026
- 2026Overcoming the Impedance Mismatch: A Theoretical Roadmap for Fusing Foundation Models and Knowledge Graphs21 Apr 2026
- 2026C-voting: Confidence-Based Test-Time Voting without Explicit Energy Functions15 Apr 2026
- 2026Visual Perceptual to Conceptual First-Order Rule Learning Networks9 Apr 2026
- 2026Metriplector: From Field Theory to Neural Architecture31 Mar 2026
- 2026Large Neighborhood Search meets Iterative Neural Constraint Heuristics21 Mar 2026
- 2026AS2 -- Attention-Based Soft Answer Sets: An End-to-End Differentiable Neuro-Soft-Symbolic Reasoning Architecture19 Mar 2026
- 2026Beyond Test-Time Memory: State-Space Optimal Control for LLM Reasoning10 Mar 2026
- 2026Neuro-symbolic Action Masking for Deep Reinforcement Learning11 Feb 2026
- 2026Step-resolved data attribution for looped transformers10 Feb 2026
- 2026Lipschitz Multiscale Deep Equilibrium Models: A Theoretically Guaranteed and Accelerated Approach3 Feb 2026
- 2026ToolGate: Contract-Grounded and Verified Tool Execution for LLMs8 Jan 2026
- 2025Constructing a Neuro-Symbolic Mathematician from First Principles31 Dec 2025
- 2025Modal Logic Neural Networks3 Dec 2025
- 2025PID-controlled Langevin Dynamics for Faster Sampling of Generative Models16 Nov 2025
- 2025Reasoning: From Reflection to Solution12 Nov 2025
- 2025From Sequential to Recursive: Enhancing Decision-Focused Learning with Bidirectional Feedback11 Nov 2025
- 2025ORGEval: Graph-Theoretic Evaluation of LLMs in Optimization Modeling31 Oct 2025
- 2025Generalizable Reasoning through Compositional Energy Minimization23 Oct 2025
- 2025Teaching Transformers to Solve Combinatorial Problems through Efficient Trial & Error26 Sep 2025
- 2025Logic of Hypotheses: from Zero to Full Knowledge in Neurosymbolic Integration25 Sep 2025
- 2025DeepGraphLog for Layered Neurosymbolic AI9 Sep 2025
- 2025Scaling Neuro-symbolic Problem Solving: Solver-Free Learning of Constraints and Objectives28 Aug 2025
- 2025Recurrent Self-Attention Dynamics: An Energy-Agnostic Perspective from Jacobians26 May 2025
- 2025Reasoning in Neurosymbolic AI22 May 2025
- 2025Building Intelligent Agents with Neuro-Symbolic Concepts9 May 2025
- 2025CTSketch: Compositional Tensor Sketching for Scalable Neurosymbolic Learning31 Mar 2025
- 2025Lobster: A GPU-Accelerated Framework for Neurosymbolic Programming27 Mar 2025
- 2025Neuro-symbolic Weak Supervision: Theory and Semantics24 Mar 2025
- 2025A Study on Neuro-Symbolic Artificial Intelligence: Healthcare Perspectives23 Mar 2025
- 2025Verification Learning: Make Unsupervised Neuro-Symbolic System Feasible17 Mar 2025
50 newest of 173 All 173 (JSON)
- 2022On the Paradox of Learning to Reason from Datacited by 93
- 2023Scallop: A Language for Neurosymbolic Programmingcited by 63
- 2022Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matricescited by 37
- 2022NeuPSL: Neural Probabilistic Soft Logiccited by 34
- 2022Backpropagation through Combinatorial Algorithms: Identity with Projection Workscited by 29
- 2022Deep Symbolic Learning: Discovering Symbols and Rules from Perceptionscited by 20
- 2024Neuro-symbolic Learning Yielding Logical Constraintscited by 12
- 2023Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matricescited by 9
- 2024Efficient Rectification of Neuro-Symbolic Reasoning Inconsistencies by Abductive Reflectioncited by 9
- 2024LogiCity: Advancing Neuro-Symbolic AI with Abstract Urban Simulationcited by 8
- 2023Deciphering Raw Data in Neuro-Symbolic Learning with Provable Guaranteescited by 6
- 2024DiLA: Enhancing LLM Tool Learning with Differential Logic Layercited by 6
12 most cited of 34 All 34 (JSON)
- 2026Reasoning with Neural Cellular Automata28 Sep 2026
- 2026The Geometry of Logic: Stratification Induces Semantic Structure and Robust Reasoning26 Sep 2026
- 2026G-RRM: Guiding Symbolic Solvers with Recurrent Reasoning Models2 Jul 2026
- 2026Retrieval-Warmed Energy-Based Reasoning: A Five-Arm Ablation Methodology for Diffusion-as-Inference on Structured Reasoning Tasks25 Jun 2026
- 2026Streamlined Constraint Reasoning via CNN Pattern Recognition on Enumerated Solutions19 May 2026
- 2026Visual Perceptual to Conceptual First-Order Rule Learning Networks9 Apr 2026
- 2026AS2 -- Attention-Based Soft Answer Sets: An End-to-End Differentiable Neuro-Soft-Symbolic Reasoning Architecture19 Mar 2026
- 2026Beyond Test-Time Memory: State-Space Optimal Control for LLM Reasoning10 Mar 2026
- 2025Reasoning: From Reflection to Solution12 Nov 2025
- 2025Logic of Hypotheses: from Zero to Full Knowledge in Neurosymbolic Integration25 Sep 2025
- 2025DeepGraphLog for Layered Neurosymbolic AI9 Sep 2025
- 2025Reasoning in Neurosymbolic AI22 May 2025
12 newest of 34 All 34 (JSON)
- 2023Dirichlet Diffusion Score Model for Biological Sequence Generationcited by 73
- 2022Deep Equilibrium Approaches to Diffusion Modelscited by 42
- 2022Graphically Structured Diffusion Modelscited by 11
- 2026Constraint-Aware Flow Matching: Decision Aligned End-to-End Training for Constrained Samplingcited by 3
- 2026Blocked Gibbs meets Diffusion Transformers: Unsupervised Learning for Constraint Optimizationcited by 0
- 2026Diff2SP: Diffusion Models for Correlated Scenario Generation in Stochastic Programmingcited by 0
- 2026Let It Go or Learn to Self-Correct: Continuous Diffusion for Constrained Discrete Taskscited by 0
- 2026Let It Go or Learn to Self-Correct: Continuous Diffusion for Constrained Discrete Tasks8 Sep 2026
- 2026Diff2SP: Diffusion Models for Correlated Scenario Generation in Stochastic Programming4 Jun 2026
- 2026Blocked Gibbs meets Diffusion Transformers: Unsupervised Learning for Constraint Optimization24 May 2026
- 2026Constraint-Aware Flow Matching: Decision Aligned End-to-End Training for Constrained Sampling12 May 2026
- 2023Dirichlet Diffusion Score Model for Biological Sequence Generation18 May 2023
- 2022Deep Equilibrium Approaches to Diffusion Models23 Oct 2022
- 2022Graphically Structured Diffusion Models20 Oct 2022
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
- 2021DC3: A learning method for optimization with hard constraintscited by 181
- 2021End-to-End Constrained Optimization Learning: A Surveycited by 154
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
- 2021Implicit MLE: Backpropagating Through Discrete Exponential Family Distributionscited by 97
- 2021On Training Implicit Modelscited by 73
- 2021Neuro-Symbolic Artificial Intelligence: Current Trendscited by 54
- 2021CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraintscited by 49
- 2022Sub-Task Decomposition Enables Learning in Sequence to Sequence Taskscited by 41
- 2024Artificial Kuramoto Oscillatory Neuronscited by 37
- 2024Learning Iterative Reasoning through Energy Diffusioncited by 36
- 2021From Machine Learning to Robotics: Challenges and Opportunities for Embodied Intelligencecited by 35
12 most cited of 128 All 128 (JSON)
- 2026XLOG: A CUDA-Native Engine for Neurosymbolic Integration23 Sep 2026
- 2026When Recursive Models Finish Computing22 Sep 2026
- 2026Soft Symbol Grounding for Prototypical Concepts10 Sep 2026
- 2026DualCert: A Solver for the Traveling Salesman Problem with Constraint-Coupled Learning10 Aug 2026
- 2026Anatomy of a Sound Neural Reasoner: One-Shot Amortization, First-Pass Poisoning, and Search Inertness in Clue-Rich Completion22 Jul 2026
- 2026Neural Certificate Pricing for Combinatorial Optimization Problems1 Jul 2026
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraints5 Jun 2026
- 2026Position: Certified Correctness in Neural Constraint Reasoning Requires Symbolic Integration2 Jun 2026
- 2026DisjunctiveNet: Neural Symbolic Learning via Differentiable Convexified Optimization Layers28 May 2026
- 2026Winfree Oscillatory Neural Network20 May 2026
- 2026Lattice Deduction Transformers9 May 2026
- 2026Overcoming the Impedance Mismatch: A Theoretical Roadmap for Fusing Foundation Models and Knowledge Graphs21 Apr 2026
12 newest of 128 All 128 (JSON)