mlsanityData to 13 Oct 2026

When Do Learned Diffusion Proposals Help Constraint Solving? A Controlled Study on Continuous Algebraic Systems

arXiv 2607.27169 ↗First posted 29 Jul 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Solving a continuous algebraic constraint system requires two decisions: which values satisfy the constraints, and which structural augmentation renders an unsolvable system solvable. Classical solvers answer the first well and the second only by enumeration. On that discrete decision, a candidate-conditioned repair ranker choosing among K augmentations reaches the exhaustive-search ceiling at a fraction of the calls, outperforming random (0.997 vs 0.236 balanced nonlinear menu accuracy; p < 10^-70; 0.982 +/- 0.006 across seeds) and beating a budget-matched per-candidate probe on accuracy and cost. MARC turns such a system into a factor graph, over which a graph-neural diffusion denoiser proposes assignments, descent on an exact computer-algebra energy polishes them, and an exact symbolic checker certifies solutions. Evaluations of diffusion-based proposals rarely include one control: random multi-start under the same refinement budget. Applied to our system, it sharply curtails what the learned proposal contributes on the value decision. Does it beat random multi-start at choosing satisfying assignments? Only narrowly, in a predictable regime. Across trapped low-dimensional families it ties with random restart, but dominates in high dimension, where random search fails. Once variables couple, the advantage is gone. Since all methods share one polish and one checker, best-of-K random multi-start succeeds with probability exactly 1 - (1 - q(n))^K, where q(n) is single-start reachability; one measured constant, with no free parameters, reproduces the entire curve (mean absolute error 0.012). The favorable regime is not specific to our synthetic families: across eight real-world systems in robotics, positioning, optimization, and algebra, classical multi-start solved all eight, none in the learning-favorable regime. We map the regimes in which learned proposals improve solvers.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 14 of its 27 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

14 of 27 references.

References · 14

  1. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,270
  2. 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 613
  3. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 509
  4. 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 314
  5. 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 218
  6. 2018Automated Algorithm Selection: Survey and Perspectivescited by 112
  7. 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimizationcited by 59
  8. 2019Learning Warm-Start Points for AC Optimal Power Flowcited by 32
  9. 2021Accelerating Quadratic Optimization with Reinforcement Learningcited by 30
  10. 2024Constraint-Aware Diffusion Models for Trajectory Optimizationcited by 11
  11. 2025Regularized Langevin Dynamics for Combinatorial Optimizationcited by 10
  12. 2026When Is an LLM Worth It for Hyperparameter Optimization? A Budget-Matched Study on Tabular Data Finds the Warm-Start Is a Default Configuration, Not the Modelcited by 5
2 more
  1. 2024A Benchmark for Maximum Cut: Towards Standardization of the Evaluation of Learned Heuristics for Combinatorial Optimizationcited by 3
  2. 2023Unveiling the Limits of Learned Local Search Heuristics: Are You the Mightiest of the Meek?cited by 1

Built on by

Not cited yet.