Mochi: Aligning Pre-training and Inference for Efficient Graph Foundation Models via Meta-Learning
Not on the map. Why?
Abstract (arXiv)
We propose Mochi, a Graph Foundation Model that addresses task unification and training efficiency by adopting a meta-learning based training framework. Prior models pre-train with reconstruction-based objectives such as link prediction, and assume that the resulting representations can be aligned with downstream tasks through a separate unification step such as class prototypes. We demonstrate through synthetic and real-world experiments that this procedure, while simple and intuitive, has limitations that directly affect downstream task performance. To address these limitations, Mochi pre-trains on few-shot episodes that mirror the downstream evaluation protocol, aligning the training objective with inference rather than relying on a post-hoc unification step. We show that Mochi, along with its more powerful variant Mochi++, achieves competitive or superior performance compared to existing Graph Foundation Models across 25 real-world graph datasets spanning node classification, link prediction, and graph classification, while requiring 8~27 times less training time than the strongest baseline.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 53 references that are in the map. First posted on arXiv 23 Apr 2026.
Builds on
43 of 53 references.
References · 43
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2016Variational Graph Auto-Encoderscited by 1,382
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2016Learning to learn by gradient descent by gradient descentcited by 620
- 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
- 2018Meta-learning with differentiable closed-form solverscited by 397
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
31 more
- 2019Position-aware Graph Neural Networkscited by 203
- 2017Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2veccited by 198
- 2019SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learningcited by 195
- 2024LLaGA: Large Language and Graph Assistantcited by 181
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 167
- 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 148
- 2021An Empirical Study of Graph Contrastive Learningcited by 113
- 2019Meta-GNN: On Few-shot Node Classification in Graph Meta-learningcited by 105
- 2022Universal Prompt Tuning for Graph Neural Networkscited by 100
- 2023PRODIGY: Enabling In-context Learning Over Graphscited by 98
- 2020Graph Prototypical Networks for Few-shot Learning on Attributed Networkscited by 90
- 2020Graph Meta Learning via Local Subgraphscited by 89
- 2024Position: Graph Foundation Models are Already Herecited by 86
- 2024ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphscited by 85
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 85
- 2022Graph Attention Multi-Layer Perceptroncited by 83
- 2024OpenGraph: Towards Open Graph Foundation Modelscited by 78
- 2022Empowering Graph Representation Learning with Test-Time Graph Transformationcited by 67
- 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 66
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 62
- 2024AnyGraph: Graph Foundation Model in the Wildcited by 53
- 2025Graph Foundation Models: A Comprehensive Surveycited by 44
- 2022Task-Adaptive Few-shot Node Classificationcited by 43
- 2024Fully-inductive Node Classification on Arbitrary Graphscited by 39
- 2024Towards Graph Foundation Models: Learning Generalities Across Graphs via Task-Treescited by 32
- 2021A Broader Picture of Random-walk Based Graph Embeddingcited by 16
- 2021A Closer Look at Prototype Classifier for Few-shot Image Classificationcited by 15
- 2024Universal Link Predictor By In-Context Learning on Graphscited by 13
- 2024Cross-Domain Graph Data Scaling: A Showcase with Diffusion Modelscited by 8
- 2024Meta-GPS++: Enhancing Graph Meta-Learning with Contrastive Learning and Self-Trainingcited by 7
- 2023Topology Only Pre-Training: Towards Generalised Multi-Domain Graph Modelscited by 1
Built on by
Not cited yet.