When Do Learned Diffusion Proposals Help Constraint Solving? A Controlled Study on Continuous Algebraic Systems
Not on the map. Why?
Abstract (arXiv)
Solving a continuous algebraic constraint system requires two decisions: which values satisfy the constraints, and which structural augmentation renders an unsolvable system solvable. Classical solvers answer the first well and the second only by enumeration. On that discrete decision, a candidate-conditioned repair ranker choosing among K augmentations reaches the exhaustive-search ceiling at a fraction of the calls, outperforming random (0.997 vs 0.236 balanced nonlinear menu accuracy; p < 10^-70; 0.982 +/- 0.006 across seeds) and beating a budget-matched per-candidate probe on accuracy and cost. MARC turns such a system into a factor graph, over which a graph-neural diffusion denoiser proposes assignments, descent on an exact computer-algebra energy polishes them, and an exact symbolic checker certifies solutions. Evaluations of diffusion-based proposals rarely include one control: random multi-start under the same refinement budget. Applied to our system, it sharply curtails what the learned proposal contributes on the value decision. Does it beat random multi-start at choosing satisfying assignments? Only narrowly, in a predictable regime. Across trapped low-dimensional families it ties with random restart, but dominates in high dimension, where random search fails. Once variables couple, the advantage is gone. Since all methods share one polish and one checker, best-of-K random multi-start succeeds with probability exactly 1 - (1 - q(n))^K, where q(n) is single-start reachability; one measured constant, with no free parameters, reproduces the entire curve (mean absolute error 0.012). The favorable regime is not specific to our synthetic families: across eight real-world systems in robotics, positioning, optimization, and algebra, classical multi-start solved all eight, none in the learning-favorable regime. We map the regimes in which learned proposals improve solvers.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 14 of its 27 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
14 of 27 references.
References · 14
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,270
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 613
- 2022DiGress: Discrete Denoising diffusion for graph generationcited by 509
- 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 314
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 218
- 2018Automated Algorithm Selection: Survey and Perspectivescited by 112
- 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimizationcited by 59
- 2019Learning Warm-Start Points for AC Optimal Power Flowcited by 32
- 2021Accelerating Quadratic Optimization with Reinforcement Learningcited by 30
- 2024Constraint-Aware Diffusion Models for Trajectory Optimizationcited by 11
- 2025Regularized Langevin Dynamics for Combinatorial Optimizationcited by 10
- 2026When Is an LLM Worth It for Hyperparameter Optimization? A Budget-Matched Study on Tabular Data Finds the Warm-Start Is a Default Configuration, Not the Modelcited by 5
Built on by
Not cited yet.