MC-RFM: Geometry-Aware Few-Shot Adaptation via Mixed-Curvature Riemannian Flow Matching
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Parameter-efficient adaptation of pretrained vision models is commonly performed through linear probes, prompts, low-rank updates, or lightweight residual modules. While effective, these methods usually treat adaptation as a discrete Euclidean perturbation of frozen representations, without explicitly modeling the geometry of the task-induced feature displacement. We propose textscMC-RFM, a mixed-curvature Riemannian flow-matching framework for few-shot adaptation of frozen visual backbones. The key idea is to represent adapted features on a product manifold combining a hyperbolic factor, which captures hierarchy-sensitive semantic structure, and a Euclidean factor, which preserves locally discriminative visual variation. Adaptation is formulated as a task-conditioned continuous transport from frozen features to support-set prototypes, trained with a flow-matching objective and coupled to a hybrid prototype-linear classifier. The method is lightweight, backbone-agnostic, and operates entirely on cached frozen features. Across seven visual recognition benchmarks, five frozen backbones, and 1/4/16-shot regimes, textscMC-RFM is the best-performing method in a majority of evaluated settings, with the strongest gains on Transformer backbones and fine-grained datasets. Ablations show that the mixed-curvature head, task conditioning, adaptive branch gating, prototype shrinkage, and discriminative supervision each contribute to performance. These results suggest that few-shot adaptation benefits not only from deciding which parameters to update, but also from modeling how representations should move through a geometry matched to the structure of the downstream task.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 37 of its 43 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
37 of 43 references.
Closest ancestors · 4
Same direction, newest first
- 2023Flow Matching on General Geometries7 Feb
- 2023Improving and generalizing flow-based generative models with minibatch optimal transport1 Feb
- 2022Flow Matching for Generative Modeling6 Oct
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
Other references · 33
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2022A ConvNet for the 2020scited by 3,545
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
21 more
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2020Supervised Contrastive Learningcited by 2,803
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2013Describing Textures in the Wildcited by 2,110
- 2013Fine-Grained Visual Classification of Aircraftcited by 1,701
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
- 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 674
- 2021Intriguing Properties of Vision Transformerscited by 446
- 2019Hyperbolic Graph Convolutional Neural Networkscited by 400
- 2018Hyperbolic Neural Networkscited by 393
- 2018Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometrycited by 261
- 2019Hyperbolic Graph Neural Networkscited by 244
- 2019Hyperbolic Image Embeddingscited by 219
- 2021TransFG: A Transformer Architecture for Fine-grained Recognitioncited by 131
- 2022Hyperbolic Vision Transformers: Combining Improvements in Metric Learningcited by 109
- 2022Hyperbolic Image Segmentationcited by 101
- 2019Mixed-curvature Variational Autoencoderscited by 85
- 2023Neural Latent Geometry Search: Product Manifold Inference via Gromov-Hausdorff-Informed Bayesian Optimizationcited by 18
- 2026TopoLoRA-SAM: Topology-Aware Parameter-Efficient Adaptation of Foundation Segmenters for Thin-Structure and Cross-Domain Binary Semantic Segmentationcited by 6
- 2026AdapterTune: Zero-Initialized Low-Rank Adapters for Frozen Vision Transformerscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Direct Product Flow Matching: Decoupling Radial and Angular Dynamics for Few-Shot Adaptation
- 2026Path-Decoupled Hyperbolic Flow Matching for Few-Shot Adaptation
- 2024Riemannian Flow Matching Policy for Robot Motion Learning
- 2026SGMatch: Semantic-Guided Non-Rigid Shape Matching with Flow Regularization
- 2026Latent Riemannian Flow Matching for Geometry-Grounded 3D Foundation Models
- 2026Geometry-Aware Image Flow Matching
- 2026Manifold-Stable Flow Matching
- 2024Fast and Robust Visuomotor Riemannian Flow Matching Policy