mlsanityData to 7 Oct 2026

ManifoldCache: Training-Free Diffusion Acceleration via Constraint Manifold Caching

arXiv 2610.04510 ↗First posted 3 Oct 2026cs.AI cs.LGcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Diffusion models for structured scientific generation must produce samples satisfying hard geometric constraints imposed by physics, chemistry, or biology, yet inference in these settings is prohibitively slow, demanding hundreds to thousands of neural-function evaluations per sample. We unify eight state-of-the-art models spanning medical volumetrics, molecular conformations, protein backbone design, crystal structure prediction, and multi-view 3D scenes under a single abstraction, Constraint-Manifold Diffusion Models (CMDMs), in which the target distribution is supported on a manifold defined by an externally specified constraint map. All existing acceleration families fail on this class: quantization exhausts memory on high-dimensional volumetric operators; pruning breaks constraint fidelity; fast ODE solvers allow trajectories to drift off the constraint manifold; and feature-caching heuristics are blind to constraint geometry, inducing mode confusion in the high-noise regime. We introduce ManifoldCache, the first training-free, data-free accelerator designed from first principles for CMDMs. The key insight is that the conditional score decomposes orthogonally into a normal component, which enforces constraint satisfaction, and a tangential component, which navigates within the manifold. Exploiting this structure, we prove that the noise-schedule midpoint is a sharp safe-caching boundary: caching before it incurs provably bounded error, while caching after it guarantees a strictly positive fraction of trajectories suffer mode confusion, a gap that persists up to the boundary. We further prove that deeper network blocks admit provably larger certified cache strides within the safe phase, as a consequence of the score decomposition propagating through block Jacobians. The resulting schedule requires no calibration data, along with zero training overhead.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. First posted on arXiv 3 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Geometric Constraints in Probabilistic Manifolds: A Bridge from Molecular Dynamics to Structured Diffusion Processes
  2. 2023Diffusion Models for Constrained Domains
  3. 2025Predictive Feature Caching for Training-free Acceleration of Molecular Geometry Generation
  4. 2023Manifold Diffusion Fields
  5. 2026Geometry-Preserving Neural Architectures on Manifolds with Boundary
  6. 2024Diffusion Models as Constrained Samplers for Optimization with Unknown Constraints
  7. 2026Provably Learning Diffusion Models under the Manifold Hypothesis: Collapse and Refine
  8. 2023Modeling Molecular Structures with Intrinsic Diffusion Models