mlsanityData to 14 Oct 2026

Support-Conditioned Flow Matching Is Kernel Smoothing

arXiv 2605.13386 ↗First posted 13 May 2026cs.LG stat.MLcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Generative models are often conditioned on a small set of examples via cross-attention. Under the Gaussian optimal-transport path, we show that the exact velocity field induced by a finite support set is a Nadaraya--Watson kernel smoother whose bandwidth decreases with flow time, from broad averaging at early steps to nearest-neighbor at late steps. A single Gaussian-kernel attention head exactly computes this field, connecting cross-attention conditioning to classical kernel theory. The theory predicts three failure regimes: nearest-neighbor collapse of the kernel at high dimension, mismatch between the isotropic kernel and the data geometry, and insufficient support for nonparametric estimation. Experiments on Gaussian mixtures, spherical shells, and DINOv2 ImageNet features confirm that learned conditioning improves in precisely these regimes, and that IP-Adapter's cross-attention implements approximate NW smoothing in practice.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 17 of its 25 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

17 of 25 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Flow Matching Neural Processes29 Dec
  2. 2025From Navigation to Refinement: Revealing the Two-Stage Nature of Flow-based Diffusion Models through Oracle Velocity2 Dec
  3. 2025On the minimax optimality of Flow Matching through the connection to kernel density estimation17 Apr
  4. 2024Flow matching achieves almost minimax optimal convergence31 May
  5. 2022Flow Matching for Generative Modeling6 Oct

Other references · 12

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  3. 2020Rethinking Attention with Performerscited by 1,601
  4. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  5. 2019Transformer Dissection: A Unified Understanding of Transformer's Attention via the Lens of Kernelcited by 213
  6. 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 212
  7. 2022Few-Shot Diffusion Modelscited by 38
  8. 2023Context Diffusion: In-Context Aware Image Generationcited by 21
  9. 2023Can a Transformer Represent a Kalman Filter?cited by 20
  10. 2023Nonlinear Meta-Learning Can Guarantee Faster Ratescited by 8
  11. 2025How Diffusion Models Memorizecited by 6
  12. 2025DiScoFormer: Plug-In Density and Score Estimation with Transformerscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Posterior Augmented Flow Matching
  2. 2025Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans
  3. 2026RiT: Vanilla Diffusion Transformers Suffice in Representation Space
  4. 2026Preconditioned Flow Matching
  5. 2025Terminal Velocity Matching
  6. 2025Flow Matching in the Low-Noise Regime: Pathologies and a Contrastive Remedy
  7. 2025Is There a Better Source Distribution than Gaussian? Exploring Source Distributions for Image Flow Matching
  8. 2026Temporal Pair Consistency for Variance-Reduced Flow Matching