Direct Product Flow Matching: Decoupling Radial and Angular Dynamics for Few-Shot Adaptation
On the map: Multimodal LLMs / vision-language models → Prompt learning and adaptation of CLIP
also in 1 more
Abstract (arXiv)
Recent flow matching (FM) methods improve the few-shot adaptation of vision-language models, by modeling cross-modal alignment as a continuous multi-step flow. In this paper, we argue that existing FM methods are inherently constrained by incompatible geometric priors on pre-trained cross-modal features, resulting in suboptimal adaptation performance. We first analyze these methods from a polar decomposition perspective (i.e., radial and angular sub-manifolds). Under this new geometric view, we identify three overlooked limitations in them: 1) Angular dynamics distortion: The radial-angular coupling induces non-uniform speed on the angular sub-manifold, leading to regression training difficulty and extra truncation errors. 2) Radial dynamics neglect: Feature normalization discards modality confidence, failing to distinguish out-of-distribution and in-distribution data, and abandoning crucial radial dynamics. 3) Context-agnostic unconditional flow: Dataset-specific information loss during pre-trained cross-modal feature extraction remains unrecovered. To resolve these issues, we propose warped product flow matching (WP-FM), a unified Riemannian framework that reformulates alignment on a warped product manifold. Within this framework, we derive direct product flow matching (DP-FM) by introducing a constant-warping metric, which yields a decoupled cylindrical manifold (i.e., direct product manifold). DP-FM enables independent radial evolution and constant-speed angular geodesic transport, effectively eliminating angular dynamics distortion while preserving radial consistency. Meanwhile, we incorporate classifier-free guidance by conditioning the flow on the pre-trained VLMs' hidden states to inject missing dataset-specific information. Extensive results across 11 benchmarks have demonstrated that DP-FM achieves a new state-of-the-art for multi-step few-shot adaptation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Prompt learning and adaptation of CLIP, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 39 of its 49 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
39 of 49 references.
Closest ancestors · 7
Same direction, newest first
- 2024Low-Rank Few-Shot Adaptation of Vision-Language Models28 May
- 2023Visual-Language Prompt Tuning with Knowledge-guided Context Optimization23 Mar
- 2022Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classification19 Jul
- 2022Prompt-aligned Gradient for Prompt Tuning30 May
- 2022Conditional Prompt Learning for Vision-Language Models10 Mar
- 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapters9 Oct
- 2021Learning to Prompt for Vision-Language Models2 Sep
Other references · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
20 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2013Describing Textures in the Wildcited by 2,125
- 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
- 2024Autoregressive Image Generation without Vector Quantizationcited by 651
- 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 532
- 2023Simple diffusion: End-to-end diffusion for high resolution imagescited by 422
- 2023Flow Matching on General Geometriescited by 265
- 2023Hyperbolic Image-Text Representationscited by 136
- 2023Relay Diffusion: Unifying diffusion process across resolutions for image synthesiscited by 79
- 2023Understanding the Feature Norm for Out-of-Distribution Detectioncited by 27
- 2025Exploring Cross-Modal Flows for Few-Shot Learningcited by 6
- 2026Path-Decoupled Hyperbolic Flow Matching for Few-Shot Adaptationcited by 4
- 2026Bi-Anchor Interpolation Solver for Accelerating Generative Modelingcited by 3
- 2025Angular Gradient Sign Method: Uncovering Vulnerabilities in Hyperbolic Networkscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026MC-RFM: Geometry-Aware Few-Shot Adaptation via Mixed-Curvature Riemannian Flow Matching
- 2025Rethinking Unsupervised Cross-modal Flow Estimation: Learning from Decoupled Optimization and Consistency Constraint
- 2026Perceptual Flow Matching for Few-Step Generative Modeling
- 2025Flow Matching in the Low-Noise Regime: Pathologies and a Contrastive Remedy
- 2026Manifold-Stable Flow Matching
- 2025Value Gradient Guidance for Flow Matching Alignment
- 2026Posterior Augmented Flow Matching
- 2026SubFlow: Sub-mode Conditioned Flow Matching for Diverse One-Step Generation