Flow Matching Reinforcement for 3D Mesh Generation via Dynamic Homing Optimization
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Flow matching is central to 3D generation, yet in practice its reinforcement learning (RL) methods are largely adapted from 2D visual generation. Representative DPO-, GRPO-, and NFT-style objectives, when applied to negative trajectories, mainly steer predicted velocities away from the corresponding directions without explicitly specifying a target velocity field toward preferred samples. In 3D generation, constrained by pretrained model capabilities, rollout diversity, and reward-distribution complexity, directly applying these RL methods yields limited gains in geometric quality. We introduce a forward-process RL method Dynamic Homing Optimization (DHO), which reformulates negative-trajectory optimization as positive-sample attraction-guided dynamic homing. Specifically, Minimum-Cost Attractive Matching (MAM) assigns each negative sample a distinct positive target, and Time-Aware Dynamic Correction (TDC) then redirects its trajectory toward the target using a remaining-time-aware corrective velocity. Building on asynchronous online DHO, we develop Flow3D-Pro, an image-to-3D geometry generation framework. Experiments show that DHO outperforms representative DPO-, GRPO-, and NFT-style objectives in 3D generation, while Flow3D-Pro produces higher-quality 3D geometry than existing mesh generation methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 60 of its 61 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
60 of 61 references.
Closest ancestors · 10
Same direction, newest first
- 2026DenseGRPO: From Sparse to Dense Reward for Flow Matching Model Alignment28 Jan
- 2025Principled RL for Flow Matching Emerges from the Chunk-level Policy Optimization24 Oct
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Process19 Sep
- 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDE29 Jul
- 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
- 2025Flow-GRPO: Training Flow Matching Models via Online RL8 May
- 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov
- 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewards29 Sep
- 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Models25 May
- 2023Training Diffusion Models with Reinforcement Learning22 May
Other references · 50
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2023Consistency Modelscited by 1,778
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
38 more
- 2025Qwen-Image Technical Reportcited by 973
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 418
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
- 2025Improving Video Generation with Human Feedbackcited by 267
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 262
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 231
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
- 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understandingcited by 199
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
- 2025Native and Compact Structured Latents for 3D Generationcited by 157
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
- 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
- 2026Generative Modeling via Driftingcited by 98
- 2024PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Acceleratorcited by 95
- 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 78
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 41
- 2024Preference Alignment with Flow Matchingcited by 11
- 2026MeshFlow: Mesh Generation with Equivariant Flow Matchingcited by 3
- 2026Qwen-Image-2.0-RL Technical Reportcited by 3
- 2026Mesh-Pro: Asynchronous Advantage-guided Ranking Preference Optimization for Artist-style Quadrilateral Mesh Generationcited by 2
- 2026ROAR-3D: Routing Arbitrary Views for High-Fidelity 3D Generationcited by 2
- 2026TriFlow: Generating Artist-Like 3D Mesh Topology via Nearest-Vertex Vector Fieldscited by 2
- 2026DreamCharacter-1: From 3D Generative Foundation Models to Product-Ready Character Generationcited by 1
- 2026Flow3D-OPD: Multi-Teacher On-Policy Distillation for 3D Geometry Generation with Flow-Matching Diffusion Transformercited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Constrained Flow Matching via Lagrangian Dual Flows
- 2025On the Guidance of Flow Matching
- 2026LeapAlign: Post-Training Flow Matching Models at Any Generation Step by Building Two-Step Trajectories
- 2026Curvature-Adaptive Consistency Flow Matching: Autonomous Trajectory Optimization via Reinforcement Learning
- 2026FlowDPG: Deterministic Policy Gradient on Flow Matching Policies for Real-World Manipulation
- 2025Learning Straight Flows: Variational Flow Matching for Efficient Generation
- 2024Optimal Flow Matching: Learning Straight Trajectories in Just One Step
- 2026Flow-DPPO: Divergence Proximal Policy Optimization for Flow Matching Models