Learning Incompressible 3D Flows from Sparse Samples: A Set Transformer Approach to Divergence-Free Kernel Fitting
Not on the map. Why?
Abstract (arXiv)
Recovering divergence-free velocity fields from sparse and corrupted observations requires reconciling physical consistency, expressive representations, and robustness to missing data. We introduce DFK-Former, a set-to-field transformer that reconstructs divergence-free velocity fields from sparse, noisy, and irregularly sampled 3D observations. The model is inherently invariant to the number and ordering of input samples and predicts the parameters of a divergence-free kernel representation, producing continuous, mesh-free velocity fields that satisfy incompressibility exactly by construction rather than approximately through soft constraints or projection operators. Unlike existing divergence-free kernel approaches, which estimate kernel coefficients via a separate optimization for each field, DFK-Former predicts these coefficients directly in a single forward pass. This eliminates costly iterative fitting while providing a learned prior that enables accurate reconstruction even when observations are insufficient to uniquely determine the field. To enhance representational power, we introduce adaptive and anisotropic divergence-free kernels that preserve exact incompressibility guarantees while capturing more complex flow structures. Extensive experiments across varying levels of sparsity, noise, and occlusion, including transfer to real Direct Numerical Simulation (DNS) turbulence data, demonstrate substantial gains in both accuracy and efficiency. DFK-Former reduces endpoint error by up to 4.6x compared to per-field divergence-free-kernel optimization, while reconstructing each field in 7.5 ms instead of 9.8 s, yielding a speedup of more than three orders of magnitude. These results establish direct, feed-forward prediction of divergence-free kernel parameters as a practical and effective paradigm for physically consistent velocity-field reconstruction from sparse observations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 50 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
27 of 50 references.
References · 27
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2017Deep Setscited by 1,421
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2019The frontier of simulation-based inferencecited by 502
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 473
- 2018Conditional Neural Processescited by 426
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
15 more
- 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 242
- 2016Accelerating Eulerian Fluid Simulation With Convolutional Networkscited by 130
- 2018Meta-Learning Probabilistic Inference For Predictioncited by 110
- 2018Iterative Amortized Inferencecited by 94
- 2022Neural Conservation Laws: A Divergence-Free Perspectivecited by 70
- 2021Preconditioned training of normalizing flows for variational inference in inverse problemscited by 20
- 2023RecFNO: a resolution-invariant flow and heat field reconstruction method from sparse observations via Fourier neural operatorcited by 19
- 2025Operator Learning for Reconstructing Flow Fields from Sparse Measurements: an Energy Transformer Approachcited by 12
- 2024Deep Operator Learning for High-Fidelity Fluid Flow Field Reconstruction from Sparse Sensor Measurementscited by 9
- 2026Project and Generate: Divergence-Free Neural Operators for Incompressible Flowscited by 7
- 2025Representing Flow Fields with Divergence-Free Kernels for Reconstructioncited by 5
- 2022NIERT: Accurate Numerical Interpolation through Unifying Scattered Data Representations using Transformer Encodercited by 4
- 2024HDNet: Physics-Inspired Neural Network for Flow Estimation based on Helmholtz Decompositioncited by 4
- 2026LagrangianSplats: Divergence-Free Transport of Gaussian Primitives for Fluid Reconstructioncited by 2
- 2026DDFKs: Fluid Simulation with Dynamic Divergence-Free Kernelscited by 1
Built on by
Not cited yet.