mlsanityData to 14 Oct 2026

Direct Product Flow Matching: Decoupling Radial and Angular Dynamics for Few-Shot Adaptation

arXiv 2605.05054 ↗First posted 6 May 2026cs.CV cs.AI cs.LGcited by 1

On the map: Multimodal LLMs / vision-language models → Prompt learning and adaptation of CLIP

also in 1 more
Abstract (arXiv)

Recent flow matching (FM) methods improve the few-shot adaptation of vision-language models, by modeling cross-modal alignment as a continuous multi-step flow. In this paper, we argue that existing FM methods are inherently constrained by incompatible geometric priors on pre-trained cross-modal features, resulting in suboptimal adaptation performance. We first analyze these methods from a polar decomposition perspective (i.e., radial and angular sub-manifolds). Under this new geometric view, we identify three overlooked limitations in them: 1) Angular dynamics distortion: The radial-angular coupling induces non-uniform speed on the angular sub-manifold, leading to regression training difficulty and extra truncation errors. 2) Radial dynamics neglect: Feature normalization discards modality confidence, failing to distinguish out-of-distribution and in-distribution data, and abandoning crucial radial dynamics. 3) Context-agnostic unconditional flow: Dataset-specific information loss during pre-trained cross-modal feature extraction remains unrecovered. To resolve these issues, we propose warped product flow matching (WP-FM), a unified Riemannian framework that reformulates alignment on a warped product manifold. Within this framework, we derive direct product flow matching (DP-FM) by introducing a constant-warping metric, which yields a decoupled cylindrical manifold (i.e., direct product manifold). DP-FM enables independent radial evolution and constant-speed angular geodesic transport, effectively eliminating angular dynamics distortion while preserving radial consistency. Meanwhile, we incorporate classifier-free guidance by conditioning the flow on the pre-trained VLMs' hidden states to inject missing dataset-specific information. Extensive results across 11 benchmarks have demonstrated that DP-FM achieves a new state-of-the-art for multi-step few-shot adaptation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Prompt learning and adaptation of CLIP, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 39 of its 49 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

39 of 49 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024Low-Rank Few-Shot Adaptation of Vision-Language Models28 May
  2. 2023Visual-Language Prompt Tuning with Knowledge-guided Context Optimization23 Mar
  3. 2022Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classification19 Jul
  4. 2022Prompt-aligned Gradient for Prompt Tuning30 May
  5. 2022Conditional Prompt Learning for Vision-Language Models10 Mar
  6. 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapters9 Oct
  7. 2021Learning to Prompt for Vision-Language Models2 Sep

Other references · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2022Classifier-Free Diffusion Guidancecited by 5,847
  9. 2022Flow Matching for Generative Modelingcited by 5,702
  10. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  11. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  12. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
20 more
  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  2. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  4. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  5. 2013Describing Textures in the Wildcited by 2,125
  6. 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
  7. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
  8. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  9. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
  10. 2024Autoregressive Image Generation without Vector Quantizationcited by 651
  11. 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 532
  12. 2023Simple diffusion: End-to-end diffusion for high resolution imagescited by 422
  13. 2023Flow Matching on General Geometriescited by 265
  14. 2023Hyperbolic Image-Text Representationscited by 136
  15. 2023Relay Diffusion: Unifying diffusion process across resolutions for image synthesiscited by 79
  16. 2023Understanding the Feature Norm for Out-of-Distribution Detectioncited by 27
  17. 2025Exploring Cross-Modal Flows for Few-Shot Learningcited by 6
  18. 2026Path-Decoupled Hyperbolic Flow Matching for Few-Shot Adaptationcited by 4
  19. 2026Bi-Anchor Interpolation Solver for Accelerating Generative Modelingcited by 3
  20. 2025Angular Gradient Sign Method: Uncovering Vulnerabilities in Hyperbolic Networkscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026MC-RFM: Geometry-Aware Few-Shot Adaptation via Mixed-Curvature Riemannian Flow Matching
  2. 2025Rethinking Unsupervised Cross-modal Flow Estimation: Learning from Decoupled Optimization and Consistency Constraint
  3. 2026Perceptual Flow Matching for Few-Step Generative Modeling
  4. 2025Flow Matching in the Low-Noise Regime: Pathologies and a Contrastive Remedy
  5. 2026Manifold-Stable Flow Matching
  6. 2025Value Gradient Guidance for Flow Matching Alignment
  7. 2026Posterior Augmented Flow Matching
  8. 2026SubFlow: Sub-mode Conditioned Flow Matching for Diverse One-Step Generation