Towards a Generic Representation of Combinatorial Problems for Learning-Based Approaches
Not on the map. Why?
Abstract (arXiv)
In recent years, there has been a growing interest in using learning-based approaches for solving combinatorial problems, either in an end-to-end manner or in conjunction with traditional optimization algorithms. In both scenarios, the challenge lies in encoding the targeted combinatorial problems into a structure compatible with the learning algorithm. Many existing works have proposed problem-specific representations, often in the form of a graph, to leverage the advantages of textitgraph neural networks. However, these approaches lack generality, as the representation cannot be easily transferred from one combinatorial problem to another one. While some attempts have been made to bridge this gap, they still offer a partial generality only. In response to this challenge, this paper advocates for progress toward a fully generic representation of combinatorial problems for learning-based approaches. The approach we propose involves constructing a graph by breaking down any constraint of a combinatorial problem into an abstract syntax tree and expressing relationships (e.g., a variable involved in a constraint) through the edges. Furthermore, we introduce a graph neural network architecture capable of efficiently learning from this representation. The tool provided operates on combinatorial problems expressed in the XCSP3 format, handling all the constraints available in the 2023 mini-track competition. Experimental results on four combinatorial problems demonstrate that our architecture achieves performance comparable to dedicated architectures while maintaining generality. Our code and trained models are publicly available at urlhttps://github.com/corail-research/learning-generic-csp.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 22 of its 36 references that are in the map. First posted on arXiv 9 Mar 2024.
Builds on
22 of 36 references.
References · 22
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2017Graph Attention Networkscited by 8,923
- 2016Layer Normalizationcited by 5,669
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2015Gated Graph Sequence Neural Networkscited by 796
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
- 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
- 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 318
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
10 more
- 2018Learning a SAT Solver from Single-Bit Supervisioncited by 200
- 2020Learning the Travelling Salesperson Problem Requires Rethinking Generalizationcited by 98
- 2020Combining Reinforcement Learning and Constraint Programming for Combinatorial Optimizationcited by 63
- 2018Learning to Solve NP-Complete Problems - A Graph Neural Network for Decision TSPcited by 58
- 2019Graph Colouring Meets Deep Learning: Effective Graph Neural Network Models for Combinatorial Problemscited by 40
- 2022One Model, Any CSP: Graph Neural Networks as Fast Global Search Heuristics for Constraint Satisfactioncited by 27
- 2020XCSP3-core: A Format for Representing Constraint Satisfaction/Optimization Problemscited by 7
- 2016Compact-Table: Efficiently Filtering Table Constraints with Reversible Sparse Bit-Setscited by 6
- 2021SeaPearl: A Constraint Programming Solver guided by Reinforcement Learningcited by 6
- 2023Learning a Generic Value-Selection Heuristic Inside a Constraint Programming Solvercited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 1.
5 papers.
- 2024RouteFinder: Towards Foundation Models for Vehicle Routing Problemscited by 55
- 2025Self-Supervised Transformers as Iterative Solution Improvers for Constraint Satisfactioncited by 6
- 2025FORGE: Foundational Optimization Representations from Graph Embeddingscited by 2
- 2025Reinforcement Learning-based Heuristics to Guide Domain-Independent Dynamic Programmingcited by 1
- 2026Can Computational Reducibility Lead to Transferable Models for Graph Combinatorial Optimization?cited by 0
- 2026Can Computational Reducibility Lead to Transferable Models for Graph Combinatorial Optimization?2 Mar 2026
- 2025FORGE: Foundational Optimization Representations from Graph Embeddings28 Aug 2025
- 2025Reinforcement Learning-based Heuristics to Guide Domain-Independent Dynamic Programming20 Mar 2025
- 2025Self-Supervised Transformers as Iterative Solution Improvers for Constraint Satisfaction18 Feb 2025
- 2024RouteFinder: Towards Foundation Models for Vehicle Routing Problems21 Jun 2024