Differentiation of Blackbox Combinatorial Solvers
Not on the map. Why?
Abstract (arXiv)
Achieving fusion of deep learning with combinatorial algorithms promises transformative changes to artificial intelligence. One possible approach is to introduce combinatorial building blocks into neural networks. Such end-to-end architectures have the potential to tackle combinatorial problems on raw input data such as ensuring global consistency in multi-object tracking or route planning on maps in robotics. In this work, we present a method that implements an efficient backward pass through blackbox implementations of combinatorial solvers with linear objective functions. We provide both theoretical and experimental backing. In particular, we incorporate the Gurobi MIP solver, Blossom V algorithm, and Dijkstra's algorithm into architectures that extract suitable features from raw inputs for the traveling salesman problem, the min-cost perfect matching problem and the shortest path problem. The code is available at https://github.com/martius-lab/blackbox-backprop.
Key facts. Cited by 224 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 35; 2023: 49; 2024: 47; 2025: 28; 2026: 33.
224 papers.
Sort:
By area:
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
- 2021End-to-End Constrained Optimization Learning: A Surveycited by 154
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
- 2025The Diffusion Dualitycited by 124
- 2022Semantic Probabilistic Layers for Neuro-Symbolic Learningcited by 103
- 2021Implicit MLE: Backpropagating Through Discrete Exponential Family Distributionscited by 97
- 2023A Survey of Contextual Optimization Methods for Decision Making under Uncertaintycited by 81
- 2021On Training Implicit Modelscited by 73
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
- 2021GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detectioncited by 66
- 2022Theseus: A Library for Differentiable Nonlinear Optimizationcited by 64
- 2021Decision-Focused Learning: Through the Lens of Learning to Rankcited by 61
38 more
- 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
- 2022RankSim: Ranking Similarity Regularization for Deep Imbalanced Regressioncited by 52
- 2022A-NeSI: A Scalable Approximate Method for Probabilistic Neurosymbolic Inferencecited by 50
- 2021CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraintscited by 49
- 2022Enhancing Self-Consistency and Performance of Pre-Trained Language Models through Natural Language Inferencecited by 40
- 2022PyEPO: A PyTorch-based End-to-End Predict-then-Optimize Library for Linear and Integer Programmingcited by 32
- 2022Unsupervised Learning for Combinatorial Optimization with Principled Objective Relaxationcited by 32
- 2024Logically Consistent Language Models via Neuro-Symbolic Integrationcited by 30
- 2022Backpropagation through Combinatorial Algorithms: Identity with Projection Workscited by 29
- 2022A Unified Framework for Implicit Sinkhorn Differentiationcited by 28
- 2022Learning with Combinatorial Optimization Layers: a Probabilistic Approachcited by 28
- 2022Neuro-Symbolic Entropy Regularizationcited by 27
- 2021Link Scheduling using Graph Neural Networkscited by 26
- 2022Beyond backpropagation: bilevel optimization through implicit differentiation and equilibrium propagationcited by 26
- 2021Integrated Conditional Estimation-Optimizationcited by 25
- 2021Techniques for Symbol Grounding with SATNetcited by 24
- 2021An Overview and Experimental Study of Learning-based Optimization Algorithms for Vehicle Routing Problemcited by 22
- 2021Learning Hard Optimization Problems: A Data Generation Perspectivecited by 21
- 2021Learning with Algorithmic Supervision via Continuous Relaxationscited by 21
- 2022SurCo: Learning Linear Surrogates For Combinatorial Nonlinear Optimization Problemscited by 21
- 2023A Pseudo-Semantic Loss for Autoregressive Models with Logical Constraintscited by 21
- 2021Fast Approximations for Job Shop Scheduling: A Lagrangian Dual Deep Learning Methodcited by 20
- 2021Robust and Decomposable Average Precision for Image Retrievalcited by 19
- 2023Estimate-Then-Optimize versus Integrated-Estimation-Optimization versus Sample Average Approximation: A Stochastic Dominance Perspectivecited by 19
- 2022TorchOpt: An Efficient Library for Differentiable Optimizationcited by 17
- 2023Landscape Surrogate: Learning Decision Losses for Mathematical Optimization Under Partial Informationcited by 17
- 2023Unlocking Slot Attention by Changing Optimal Transport Costscited by 16
- 2023Behavior Alignment via Reward Function Optimizationcited by 16
- 2024Decision-Focused Learning with Directional Gradientscited by 16
- 2024LinSATNet: The Positive Linear Satisfiability Neural Networkscited by 16
- 2024KLay: Accelerating Arithmetic Circuits for Neurosymbolic AIcited by 16
- 2021Self-Supervised Learning of Audio Representations from Permutations with Differentiable Rankingcited by 14
- 2022Neural Set Function Extensions: Learning with Discrete Functions in High Dimensionscited by 14
- 2023Differentiable Clustering with Perturbed Spanning Forestscited by 14
- 2022TransPath: Learning Heuristics For Grid-Based Pathfinding via Transformerscited by 13
- 2023Backpropagation of Unrolled Solvers with Folded Optimizationcited by 13
- 2023On Learning Latent Models with Multi-Instance Weak Supervisioncited by 13
- 2022Certifiable 3D Object Pose Estimation: Foundations, Learning Models, and Self-Trainingcited by 12
50 most cited of 224 All 224 (JSON)
- 2026RL-PaO: Prediction as Action in Decision Making under Uncertainty29 Sep 2026
- 2026PolyStepOR: Learning to Decide Without Optimal Decisions26 Sep 2026
- 2026Proximal Residual Value Functions for Consistent Planning and Real-Time Execution19 Sep 2026
- 2026Deciding When to Decide: Testing Operational Suboptimality Under Distributional Shift29 Aug 2026
- 2026Decision-Driven Regularization: A Blended Model for Learning and Optimization15 Aug 2026
- 2026Decision-Aware Approximation of Belief Functions for Evidential Combinatorial Optimization11 Aug 2026
- 2026DualCert: A Solver for the Traveling Salesman Problem with Constraint-Coupled Learning10 Aug 2026
- 2026Decision-Focused Learning in Network Interdiction Games10 Aug 2026
- 2026Breaking Feedback-Blindness: Utility-Augmented Transformer for Sequential Decision Making21 Jul 2026
- 2026A Solver-Free Training Method for Predict-then-Optimize17 Jun 2026
- 2026EM-NeSy: Expectation Maximization for Neurosymbolic Learning12 Jun 2026
- 2026Bellman-Taylor Score Decoding for Markov Decision Processes with State-Dependent Feasible Action Sets9 Jun 2026
38 more
- 2026FlexPath: Adapting Learned Connectivity Guidance to Path Preferences8 Jun 2026
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraints5 Jun 2026
- 2026MidSurfNet: Learning Face Pairing for Mid-surface Abstraction of Thin-walled CAD Models1 Jun 2026
- 2026Decision-Focused On-Policy Learning for Contextual Linear Optimization with Partial Feedback31 May 2026
- 2026Semi-Supervised Gaze Estimation via Disentangled Subspace Contrastive Learning26 May 2026
- 2026Regret Equals Covariance: A Closed-Form Characterization for Stochastic Optimization13 May 2026
- 2026Constraint-Aware Flow Matching: Decision Aligned End-to-End Training for Constrained Sampling12 May 2026
- 2026IGT-OMD: Implicit Gradient Transport for Decision-Focused Learning under Delayed Feedback12 May 2026
- 2026Graph Normalization: Fast Binarizing Dynamics for Differentiable MWIS6 May 2026
- 2026Decision-Focused Learning via Tangent-Space Projection of Prediction Error2 May 2026
- 2026Model Compression with Exact Budget Constraints via Riemannian Manifolds1 May 2026
- 2026OTSS: Output-Targeted Soft Segmentation for Contextual Decision-Weight Learning30 Apr 2026
- 2026AAC: Admissible-by-Architecture Differentiable Landmark Compression for ALT22 Apr 2026
- 2026Metriplector: From Field Theory to Neural Architecture31 Mar 2026
- 2026Contextual Preference Distribution Learning17 Mar 2026
- 2026SoftJAX & SoftTorch: Empowering Automatic Differentiation Libraries with Informative Gradients9 Mar 2026
- 2026Latent Spherical Flow Policy for Reinforcement Learning with Combinatorial Actions29 Jan 2026
- 2026Managing Solution Stability in Decision-Focused Learning with Cost Regularization29 Jan 2026
- 2026Differentiable Knapsack and Top-k Operators via Dynamic Programming29 Jan 2026
- 2026Learning to Optimize by Differentiable Programming23 Jan 2026
- 2026Combinatorial Optimization Augmented Machine Learning15 Jan 2026
- 2025CORL: Reinforcement Learning of MILP Policies Solved via Branch and Bound11 Dec 2025
- 2025Contrastive Learning for Semi-Supervised Deep Regression with Generalized Ordinal Rankings from Spectral Seriation10 Dec 2025
- 2025Scalable Decision Focused Learning via Online Trainable Surrogates3 Dec 2025
- 2025Geometric Algorithms for Neural Combinatorial Optimization with Constraints28 Oct 2025
- 2025Bi-Level Decision-Focused Causal Learning for Large-Scale Marketing Optimization: Bridging Observational and Experimental Data22 Oct 2025
- 2025Feasibility-Aware Decision-Focused Learning for Predicting Parameters in the Constraints6 Oct 2025
- 2025Inverse Optimization Latent Variable Models for Learning Costs Applied to Route Problems19 Sep 2025
- 2025Decision-Focused Learning Enhanced by Automated Feature Engineering for Energy Storage Optimisation6 Sep 2025
- 2025Scaling Neuro-symbolic Problem Solving: Solver-Free Learning of Constraints and Objectives28 Aug 2025
- 2025Constraints-Guided Diffusion Reasoner for Neuro-Symbolic Learning22 Aug 2025
- 2025Minimizing Surrogate Losses for Decision-Focused Learning using Differentiable Optimization15 Aug 2025
- 2025Exact Reformulation and Optimization for Direct Metric Optimization in Binary Imbalanced Classification21 Jul 2025
- 2025DAA*: Deep Angular A Star for Image-based Path Planning12 Jul 2025
- 2025Aligning Learning and Endogenous Decision-Making1 Jul 2025
- 2025The Diffusion Duality12 Jun 2025
- 2025Hidden Representation Clustering with Multi-Task Representation Learning towards Robust Online Budget Allocation1 Jun 2025
- 2025Solver-Free Decision-Focused Learning for Linear Optimization Problems28 May 2025
50 newest of 224 All 224 (JSON)
- 2022A-NeSI: A Scalable Approximate Method for Probabilistic Neurosymbolic Inferencecited by 50
- 2022Backpropagation through Combinatorial Algorithms: Identity with Projection Workscited by 29
- 2025Neurosymbolic Diffusion Modelscited by 12
- 2023Scalable Coupling of Deep Learning with Logical Reasoningcited by 4
- 2024Symbol Correctness in Deep Neural Networks Containing Symbolic Layerscited by 1
- 2024A Training Data Recipe to Accelerate A* Search with Language Modelscited by 1
- 2023Learning Modulo Theoriescited by 0
- 2024A Complexity Map of Probabilistic Reasoning for Neurosymbolic Classification Techniquescited by 0
- 2025Constraints-Guided Diffusion Reasoner for Neuro-Symbolic Learningcited by 0
- 2026EM-NeSy: Expectation Maximization for Neurosymbolic Learningcited by 0
- 2026EM-NeSy: Expectation Maximization for Neurosymbolic Learning12 Jun 2026
- 2025Constraints-Guided Diffusion Reasoner for Neuro-Symbolic Learning22 Aug 2025
- 2025Neurosymbolic Diffusion Models19 May 2025
- 2024A Training Data Recipe to Accelerate A* Search with Language Models13 Jul 2024
- 2024A Complexity Map of Probabilistic Reasoning for Neurosymbolic Classification Techniques12 Apr 2024
- 2024Symbol Correctness in Deep Neural Networks Containing Symbolic Layers6 Feb 2024
- 2023Scalable Coupling of Deep Learning with Logical Reasoning12 May 2023
- 2023Learning Modulo Theories26 Jan 2023
- 2022A-NeSI: A Scalable Approximate Method for Probabilistic Neurosymbolic Inference23 Dec 2022
- 2022Backpropagation through Combinatorial Algorithms: Identity with Projection Works30 May 2022
- 2025The Diffusion Dualitycited by 124
- 2026Constraint-Aware Flow Matching: Decision Aligned End-to-End Training for Constrained Samplingcited by 3
- 2026Constraint-Aware Flow Matching: Decision Aligned End-to-End Training for Constrained Sampling12 May 2026
- 2025The Diffusion Duality12 Jun 2025
- 2025DAA*: Deep Angular A Star for Image-based Path Planningcited by 1
- 2025DAA*: Deep Angular A Star for Image-based Path Planning12 Jul 2025
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
- 2021End-to-End Constrained Optimization Learning: A Surveycited by 154
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
- 2022Semantic Probabilistic Layers for Neuro-Symbolic Learningcited by 103
- 2021Implicit MLE: Backpropagating Through Discrete Exponential Family Distributionscited by 97
- 2023A Survey of Contextual Optimization Methods for Decision Making under Uncertaintycited by 81
- 2021On Training Implicit Modelscited by 73
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
- 2021GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detectioncited by 66
- 2022Theseus: A Library for Differentiable Nonlinear Optimizationcited by 64
- 2021Decision-Focused Learning: Through the Lens of Learning to Rankcited by 61
- 2022RankSim: Ranking Similarity Regularization for Deep Imbalanced Regressioncited by 52
12 most cited of 208 All 208 (JSON)
- 2026RL-PaO: Prediction as Action in Decision Making under Uncertainty29 Sep 2026
- 2026PolyStepOR: Learning to Decide Without Optimal Decisions26 Sep 2026
- 2026Proximal Residual Value Functions for Consistent Planning and Real-Time Execution19 Sep 2026
- 2026Deciding When to Decide: Testing Operational Suboptimality Under Distributional Shift29 Aug 2026
- 2026Decision-Driven Regularization: A Blended Model for Learning and Optimization15 Aug 2026
- 2026Decision-Aware Approximation of Belief Functions for Evidential Combinatorial Optimization11 Aug 2026
- 2026DualCert: A Solver for the Traveling Salesman Problem with Constraint-Coupled Learning10 Aug 2026
- 2026Decision-Focused Learning in Network Interdiction Games10 Aug 2026
- 2026Breaking Feedback-Blindness: Utility-Augmented Transformer for Sequential Decision Making21 Jul 2026
- 2026A Solver-Free Training Method for Predict-then-Optimize17 Jun 2026
- 2026Bellman-Taylor Score Decoding for Markov Decision Processes with State-Dependent Feasible Action Sets9 Jun 2026
- 2026FlexPath: Adapting Learned Connectivity Guidance to Path Preferences8 Jun 2026
12 newest of 208 All 208 (JSON)