mlsanityData to 14 Oct 2026

The Singularity Space: A Generative Diffusion Framework for Signal Representation

arXiv 2607.10930 ↗First posted 12 Jul 2026cs.LG cs.AI cs.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

Generative models often represent signals as dense grids of amplitudes, blurring sharp transients that are crucial for the correctness of physical signals. We introduce Singularity Space, a generative framework that represents signals through complex-plane singularities, rooted in the classical pole-residue representation of meromorphic functions. We learn a latent space of physically constrained, per-signal singularity configurations to solve an inverse problem from degraded or partial observations. The framework has three key properties: interpretability, in which each generated singularity configuration corresponds to a set of physical parameters; structural stability, which mitigates Gibbs artifacts at discontinuities; and resolution-free output reconstruction on arbitrary grids without retraining or interpolation. Our framework employs a transformer-based diffusion model that directly predicts samples at complex-plane singularity coordinates, subject to geometric constraints during sampling. As a controlled test case for sharp-feature recovery, we evaluate our framework on 1D Burgers shocks, where each shock is represented by 32 predicted singularities (an 8× reduction versus a 1024-point grid signal). Our framework preserves signal structure (TV ratio ≈ 1) under unseen test-time observation noise, achieves a 4.2× lower reconstruction error in zero-shot sub-resolution generalization than a grid-based baseline, and recovers physical parameters to 10-4 absolute error in-distribution. These results suggest that singularity-based representations may provide a practical foundation for other transient-dominated signals such as speech and biomedical signals, with potential extension to higher-dimensional domains.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 35 references that are in the map. First posted on arXiv 12 Jul 2026.

Builds on

16 of 35 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2016Layer Normalizationcited by 5,669
  5. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  6. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  7. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  8. 2018On the Spectral Bias of Neural Networkscited by 1,341
  9. 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
  10. 2024Constrained Synthesis with Projected Diffusion Modelscited by 89
  11. 2023Reflected Diffusion Modelscited by 87
  12. 2022Blending Neural Operators and Relaxation Methods in PDE Numerical Solverscited by 54
4 more
  1. 2025Inference-time Scaling of Diffusion Models through Classical Searchcited by 49
  2. 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modelingcited by 36
  3. 2025The False Promise of Zero-Shot Super-Resolution in Machine-Learned Operatorscited by 8
  4. 2025On the Practical Use of Blaschke Decomposition in Nonstationary Signal Analysiscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Learning Single Index Models with Diffusion Priors
  2. 2022Dimensionality-Varying Diffusion Process
  3. 2022Diffusion Generative Models in Infinite Dimensions
  4. 2025A Fourier Space Perspective on Diffusion Models
  5. 2026HarmoCore: Functional Latent Diffusion for Sparse Reconstruction of Oscillatory Wave Fields
  6. 2026Analyzing and Guiding Zero-Shot Posterior Sampling in Diffusion Models
  7. 2026Tunable Latent Generative Priors for Compressed Sensing and Inverse Problems
  8. 2026Learning Interpretable PDE Representations for Generative Reconstructions with Structured Sparsity