mlsanityData to 14 Oct 2026

RelPrism: A Multi-Faceted Pre-training Framework with Self-Generated Tasks for Relational Databases

arXiv 2605.23241 ↗First posted 22 May 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Relational databases (RDBs) remain the cornerstone of modern data systems and support diverse predictive tasks. Recent relational deep learning (RDL) methods enable end-to-end prediction by converting RDBs into graphs, where rows are represented as nodes and inter-table interactions are represented as edges, and then applying graph-based models for representation learning. Despite the strong capability of RDL, effective self-supervised pre-training for RDBs remains non-trivial. RDB tasks often require multi-faceted information across different perspectives and granularities. For example, user churn classification may rely more on interaction patterns, whereas consumption value prediction requires both user-item behaviors and intrinsic user attributes for fine-grained regression. Such heterogeneous needs challenge RDB representation learning, as pre-training objectives should cover comprehensive information for downstream adaptation. However, existing SSL methods typically derive supervision from a single facet, such as node-level intrinsic attributes or subgraph-level relational structures, providing limited adaptability. To this end, we propose RelPrism, a multi-faceted self-supervised learning framework for RDBs. RelPrism constructs intrinsic, relational, and hybrid attributes from distinct perspectives, and applies multi-granularity clustering to each perspective to form corresponding pseudo-task pools. Pre-training over these pools exposes representations to broader perspectives and granularity levels, yielding a stronger basis for downstream adaptation. Experiments on 14 tasks across 5 real-world datasets show that RelPrism improves ROC-AUC by 4.15% for classification and reduces MAE by 10.75% for regression over state-of-the-art baselines. Our code is available at https://anonymous.4open.science/r/RelPrism.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 49 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

24 of 49 references.

References · 24

  1. 2017Inductive Representation Learning on Large Graphscited by 6,320
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  3. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  4. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  5. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
  6. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  7. 2018Deep Graph Infomaxcited by 1,106
  8. 2019A Closer Look at Few-shot Classificationcited by 684
  9. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
  10. 2020Principal Neighbourhood Aggregation for Graph Netscited by 478
  11. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
  12. 2021SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Trainingcited by 319
12 more
  1. 2021SCARF: Self-Supervised Contrastive Learning using Random Feature Corruptioncited by 156
  2. 2021SubTab: Subsetting Features of Tabular Data for Self-Supervised Representation Learningcited by 104
  3. 2018Unsupervised Learning via Meta-Learningcited by 82
  4. 2020Trust Issues: Uncertainty Estimation Does Not Enable Reliable OOD Detection On Medical Tabular Datacited by 52
  5. 2023STUNT: Few-shot Tabular Learning with Self-generated Tasks from Unlabeled Tablescited by 49
  6. 2020Supervised Learning on Relational Databases with Graph Neural Networkscited by 48
  7. 2025RelGNN: Composite Message Passing for Relational Deep Learningcited by 48
  8. 2025Griffin: Towards a Graph-Centric Relational Database Foundation Modelcited by 47
  9. 2025Relational Transformer: Toward Zero-Shot Foundation Models for Relational Datacited by 39
  10. 2025Relational Deep Learning: Challenges, Foundations and Next-Generation Architecturescited by 23
  11. 2025A Pre-training Framework for Relational Data with Information-theoretic Principlescited by 4
  12. 2025Transaction Categorization with Relational Deep Learning in QuickBookscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.