Flow-Corrected Shape Optimization: Taming Manifold Drift in High-Dimensional 3D Models
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Optimizing 3D shapes within the latent spaces of deep generative models is fundamental to computer assisted engineering, yet remains prone to a critical failure mode we term manifold drift: the tendency of gradient-based optimization to move latent vectors away from the manifold of valid shapes. This problem is exacerbated in state-of-the-art 3D shape generative models that operate in increasingly high-dimensional latent spaces where valid shapes occupy a vanishingly small fraction of the full space. Existing mitigation strategies, including latent regularization and flow-matching approaches, either sacrifice expressiveness, demand a difficult trade-off between objective guidance and generative fidelity that remains prone to manifold drift, or are computationally infeasible to scale to modern, large-capacity 3D shape models. We introduce a novel optimizer-corrector framework that alternates between gradient steps for objective minimization and guided flow matching to drive the latent state back to the valid shape manifold. By decoupling objective minimization from flow-based correction, optimizing freely and correcting strictly, this alternating design avoids inherent trade-offs, preserving geometric validity without sacrificing expressiveness while remaining computationally feasible on modern 3D shape models. We demonstrate its effectiveness across generative priors of varying complexity, from simple vector latent spaces to large-scale architectures across a variety of downstream optimization tasks, including aerodynamic drag reduction and object compliance optimization.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 50 of its 73 references that are in the map. First posted on arXiv 7 Aug 2026.
Builds on
50 of 73 references.
Closest ancestors · 3
Same direction, newest first
- 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoders23 Dec
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
Other references · 47
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2014Going Deeper with Convolutionscited by 4,241
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
35 more
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2018Demystifying MMD GANscited by 1,293
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2022Denoising Diffusion Restoration Modelscited by 963
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2016The CMA Evolution Strategy: A Tutorialcited by 377
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 184
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2024D-Flow: Differentiating through Flows for Controlled Generationcited by 122
- 2020MeshSDF: Differentiable Iso-Surface Extractioncited by 112
- 2022Learning Smooth Neural Functions via Lipschitz Regularizationcited by 86
- 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 82
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
- 2025FlowDPS: Flow-Driven Posterior Sampling for Inverse Problemscited by 68
- 2024Gradient Guidance for Diffusion Models: An Optimization Perspectivecited by 61
- 2024Inference-Time Alignment of Diffusion Models with Direct Noise Optimizationcited by 55
- 2024Flow Priors for Linear Inverse Problems via Iterative Corrupted Trajectory Matchingcited by 53
- 2023Norm-guided latent space exploration for text-to-image generationcited by 43
- 2024Steering Rectified Flow Models in the Vector Field for Controlled Image Generationcited by 39
- 2018Geodesic Convolutional Shape Optimizationcited by 37
- 2025Diffusion Models and the Manifold Hypothesis: Log-Domain Smoothing is Geometry Adaptivecited by 20
- 2021DeepMesh: Differentiable Iso-Surface Extractioncited by 14
- 2025PhysGen: Physically Grounded 3D Shape Generation for Industrial Designcited by 6
- 2026Optimization and Generation in Aerodynamics Inverse Designcited by 5
- 2015Large scale three-dimensional topology optimisation of heat sinks cooled by natural convectioncited by 3
- 2025Adjoint-Based Aerodynamic Shape Optimization with a Manifold Constraint Learned by Diffusion Modelscited by 2
- 2025High Resolution UDF Meshing via Iterative Networkscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Topology-Aware Latent Diffusion for 3D Shape Generation
- 2026Learning on the Manifold: Unlocking Standard Diffusion Transformers with Representation Encoders
- 2026Manifold-Stable Flow Matching
- 20243D Shape Tokenization via Latent Flow Matching
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Models
- 2026Flow Matching is Adaptive to Manifold Structures
- 2026Hierarchical Flow Matching for 3D Point Cloud Generation
- 2024Multi-scale Latent Point Consistency Models for 3D Shape Generation