RELATE: A Schema-Agnostic Perceiver Encoder for Multimodal Relational Graphs
Not on the map. Why?
Abstract (arXiv)
Relational multi-table data is common in domains such as e-commerce, healthcare, and scientific research, and can be naturally represented as heterogeneous temporal graphs with multi-modal node attributes. Existing graph neural networks (GNNs) rely on schema-specific feature encoders, requiring separate modules for each node type and feature column, which hinders scalability and parameter sharing. We introduce RELATE (Relational Encoder for Latent Aggregation of Typed Entities), a schema-agnostic, plug-and-play feature encoder that can be used with any general purpose GNN. RELATE employs shared modality-specific encoders for categorical, numerical, textual, and temporal attributes, followed by a Perceiver-style cross-attention module that aggregates features into a fixed-size, permutation-invariant node representation. We evaluate RELATE on ReLGNN and HGT in the RelBench benchmark, where it achieves performance within 3% of schema-specific encoders while reducing parameter counts by up to 5x. This design supports varying schemas and enables multi-dataset pretraining for general-purpose GNNs, paving the way toward foundation models for relational graph data.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 13 of its 20 references that are in the map. First posted on arXiv 22 Oct 2025.
Builds on
13 of 20 references.
References · 13
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
- 2020Heterogeneous Graph Transformercited by 581
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
- 2024RelBench: A Benchmark for Deep Learning on Relational Databasescited by 90
- 2024Position: Graph Foundation Models are Already Herecited by 84
- 2023XTab: Cross-table Pretraining for Tabular Transformerscited by 81
- 2025Griffin: Towards a Graph-Centric Relational Database Foundation Modelcited by 41
- 2024PyTorch Frame: A Modular Framework for Multi-Modal Tabular Learningcited by 32
- 2025ConTextTab: A Semantics-Aware Tabular In-Context Learnercited by 31
- 2025FoNE: Precise Single-Token Number Embeddings via Fourier Featurescited by 21
- 2024GraphAlign: Pretraining One Graph Neural Network on Multiple Graphs via Feature Alignmentcited by 15
- 2024GraphFM: A generalist graph transformer that learns transferable representations across diverse domainscited by 14
1 more
Built on by
Citing papers per year: 2026: 1.
1 paper.