mlsanityData to 13 Oct 2026

A Systematic Study of Model Extraction Attacks on Graph Foundation Models

arXiv 2511.11912 ↗First posted 14 Nov 2025cs.LG cs.CRcited by 1

Not on the map. Why?

Abstract (arXiv)

Graph machine learning has advanced rapidly in tasks such as link prediction, anomaly detection, and node classification. As models scale up, pretrained graph models have become valuable intellectual assets because they encode extensive computation and domain expertise. Building on these advances, Graph Foundation Models (GFMs) mark a major step forward by jointly pretraining graph and text encoders on massive and diverse data. This unifies structural and semantic understanding, enables zero-shot inference, and supports applications such as fraud detection and biomedical analysis. However, the high pretraining cost and broad cross-domain knowledge in GFMs also make them attractive targets for model extraction attacks (MEAs). Prior work has focused only on small graph neural networks trained on a single graph, leaving the security implications for large-scale and multimodal GFMs largely unexplored. This paper presents the first systematic study of MEAs against GFMs. We formalize a black-box threat model and define six practical attack scenarios covering domain-level and graph-specific extraction goals, architectural mismatch, limited query budgets, partial node access, and training data discrepancies. To instantiate these attacks, we introduce a lightweight extraction method that trains an attacker encoder using supervised regression of graph embeddings. Even without contrastive pretraining data, this method learns an encoder that stays aligned with the victim text encoder and preserves its zero-shot inference ability on unseen graphs. Experiments on seven datasets show that the attacker can approximate the victim model using only a tiny fraction of its original training cost, with almost no loss in accuracy. These findings reveal that GFMs greatly expand the MEA surface and highlight the need for deployment-aware security defenses in large-scale graph learning systems.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 34 of its 45 references that are in the map. First posted on arXiv 14 Nov 2025.

Builds on

34 of 45 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,318
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,107
  4. 2017Graph Attention Networkscited by 8,888
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,712
  6. 2017Inductive Representation Learning on Large Graphscited by 6,303
  7. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,157
  8. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,435
  9. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 709
  10. 2021PointCLIP: Point Cloud Understanding by CLIPcited by 463
  11. 2021AudioCLIP: Extending CLIP to Image, Text and Audiocited by 337
  12. 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 257
22 more
  1. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 240
  2. 2023TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritancecited by 90
  3. 2023CLIP-KD: An Empirical Study of CLIP Model Distillationcited by 87
  4. 2022BOND: Benchmarking Unsupervised Outlier Node Detection on Static Attributed Graphscited by 80
  5. 2024Can GNN be Good Adapter for LLMs?cited by 71
  6. 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
  7. 2021Model Stealing Attacks Against Inductive Graph Neural Networkscited by 50
  8. 2024Text-space Graph Foundation Models: Comprehensive Benchmarks and New Insightscited by 44
  9. 2020Model Extraction Attacks on Graph Neural Networks: Taxonomy and Realizationcited by 40
  10. 2020TIMME: Twitter Ideology-detection via Multi-task Multi-relational Embeddingcited by 39
  11. 2019Adversarial Model Extraction on Graph Neural Networkscited by 22
  12. 2025CATP: Contextually Adaptive Token Pruning for Efficient and Enhanced Multimodal In-Context Learningcited by 18
  13. 2025AMMKD: Adaptive Multimodal Multi-teacher Distillation for Lightweight Vision-Language Modelscited by 13
  14. 2020Multivariate Time Series Classification with Hierarchical Variational Graph Poolingcited by 12
  15. 2024LEGO-Learn: Label-Efficient Graph Open-Set Learningcited by 10
  16. 2025CEGA: A Cost-Effective Approach for Graph-Based Model Extraction and Acquisitioncited by 9
  17. 2020Graph Partitioning and Graph Neural Network based Hierarchical Graph Matching for Graph Similarity Computationcited by 8
  18. 2025Few-Shot Graph Out-of-Distribution Detection with LLMscited by 6
  19. 2025Graph Synthetic Out-of-Distribution Exposure with Large Language Modelscited by 6
  20. 2025MLLM4TS: Leveraging Vision and Multimodal Language Models for General Time-Series Analysiscited by 5
  21. 2020CoSimGNN: Towards Large-scale Graph Similarity Computationcited by 3
  22. 2025Intellectual Property in Graph-Based Machine Learning as a Service: Attacks and Defensescited by 2

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.