mlsanityData to 14 Oct 2026

Kuramoto Orientation Diffusion Models

arXiv 2509.15328 ↗First posted 18 Sep 2025cs.LG cs.CV q-bio.NCcited by 5

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Orientation-rich images, such as fingerprints and textures, often exhibit coherent angular directional patterns that are challenging to model using standard generative approaches based on isotropic Euclidean diffusion. Motivated by the role of phase synchronization in biological systems, we propose a score-based generative model built on periodic domains by leveraging stochastic Kuramoto dynamics in the diffusion process. In neural and physical systems, Kuramoto models capture synchronization phenomena across coupled oscillators -- a behavior that we re-purpose here as an inductive bias for structured image generation. In our framework, the forward process performs textitsynchronization among phase variables through globally or locally coupled oscillator interactions and attraction to a global reference phase, gradually collapsing the data into a low-entropy von Mises distribution. The reverse process then performs textitdesynchronization, generating diverse patterns by reversing the dynamics with a learned score function. This approach enables structured destruction during forward diffusion and a hierarchical generation process that progressively refines global coherence into fine-scale details. We implement wrapped Gaussian transition kernels and periodicity-aware networks to account for the circular geometry. Our method achieves competitive results on general image benchmarks and significantly improves generation quality on orientation-dense datasets like fingerprints and textures. Ultimately, this work demonstrates the promise of biologically inspired synchronization dynamics as structured priors in generative modeling.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 42 of its 66 references that are in the map. First posted on arXiv 18 Sep 2025.

Builds on

42 of 66 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025Harmonizing Geometry and Uncertainty: Diffusion with Hyperspheres12 Jun
  2. 2022Blurring Diffusion Models12 Sep
  3. 2022Riemannian Diffusion Models16 Aug
  4. 2022Classifier-Free Diffusion Guidance26 Jul
  5. 2022Riemannian Score-Based Generative Modelling6 Feb
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  7. 2021Variational Diffusion Models1 Jul
  8. 2021A Variational Perspective on Diffusion-Based Generative Models and Score Matching5 Jun
  9. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  10. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  11. 2020Denoising Diffusion Implicit Models6 Oct
  12. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  5. 2013Auto-Encoding Variational Bayescited by 4,053
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  7. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  8. 2018Group Normalizationcited by 1,524
  9. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  10. 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 310
  11. 2018Hyperspherical Variational Auto-Encoderscited by 189
  12. 2022Generative Modelling With Inverse Heat Dissipationcited by 167
18 more
  1. 2020Riemannian Continuous Normalizing Flowscited by 145
  2. 2022Graph-Coupled Oscillator Networkscited by 124
  3. 2022Clifford Neural Layers for PDE Modelingcited by 92
  4. 2020Coupled Oscillatory Recurrent Neural Network (coRNN): An accurate and (gradient) stable architecture for learning long time dependenciescited by 82
  5. 2021Moser Flow: Divergence-based Generative Modeling on Manifoldscited by 67
  6. 2022Matching Normalizing Flows and Probability Paths on Manifoldscited by 57
  7. 2025Can Prompt Difficulty be Online Predicted for Accelerating RL Finetuning of Reasoning Models?cited by 52
  8. 2024Artificial Kuramoto Oscillatory Neuronscited by 38
  9. 2018Deep Texture Manifold for Ground Terrain Recognitioncited by 32
  10. 2022PrintsGAN: Synthetic Fingerprint Generatorcited by 30
  11. 2025Model Predictive Task Sampling for Efficient and Robust Adaptationcited by 21
  12. 2023Latent Traversals in Generative Models as Potential Flowscited by 17
  13. 2023Latent SDEs on Homogeneous Spacescited by 16
  14. 2023Traveling Waves Encode the Recent Past and Enhance Sequence Learningcited by 16
  15. 2023From Coupled Oscillators to Graph Neural Networks: Reducing Over-smoothing via a Kuramoto Model-based Approachcited by 15
  16. 2021KuraNet: Systems of Coupled Oscillators that Learn to Synchronizecited by 6
  17. 2018Sokoto Coventry Fingerprint Datasetcited by 5
  18. 2023Unified framework for diffusion generative models in SO(3): applications in computer vision and astrophysicscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026How Out-of-Equilibrium Phase Transitions can Seed Pattern Formation in Trained Diffusion Models
  2. 2026Variational Test-time Optimization for Diffusion Synchronization
  3. 2026Dynamical Regimes of Multimodal Diffusion Models
  4. 2023Spontaneous Symmetry Breaking in Generative Diffusion Models
  5. 2026Interpreting the Synchronization Gap: The Hidden Mechanism Inside Diffusion Transformers
  6. 2026The Geometry of Phase Transitions in Generative Dynamics via Projection Caustics
  7. 2025Local Diffusion Models and Phases of Data Distributions
  8. 2026Just-in-Time: Training-Free Spatial Acceleration for Diffusion Transformers