mlsanityData to 7 Oct 2026

RELATE: A Schema-Agnostic Perceiver Encoder for Multimodal Relational Graphs

arXiv 2510.19954 ↗First posted 22 Oct 2025cs.AI cs.DB cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Relational multi-table data is common in domains such as e-commerce, healthcare, and scientific research, and can be naturally represented as heterogeneous temporal graphs with multi-modal node attributes. Existing graph neural networks (GNNs) rely on schema-specific feature encoders, requiring separate modules for each node type and feature column, which hinders scalability and parameter sharing. We introduce RELATE (Relational Encoder for Latent Aggregation of Typed Entities), a schema-agnostic, plug-and-play feature encoder that can be used with any general purpose GNN. RELATE employs shared modality-specific encoders for categorical, numerical, textual, and temporal attributes, followed by a Perceiver-style cross-attention module that aggregates features into a fixed-size, permutation-invariant node representation. We evaluate RELATE on ReLGNN and HGT in the RelBench benchmark, where it achieves performance within 3% of schema-specific encoders while reducing parameter counts by up to 5x. This design supports varying schemas and enables multi-dataset pretraining for general-purpose GNNs, paving the way toward foundation models for relational graph data.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 13 of its 20 references that are in the map. First posted on arXiv 22 Oct 2025.

Builds on

13 of 20 references.

References · 13

  1. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
  2. 2020Heterogeneous Graph Transformercited by 581
  3. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
  4. 2024RelBench: A Benchmark for Deep Learning on Relational Databasescited by 90
  5. 2024Position: Graph Foundation Models are Already Herecited by 84
  6. 2023XTab: Cross-table Pretraining for Tabular Transformerscited by 81
  7. 2025Griffin: Towards a Graph-Centric Relational Database Foundation Modelcited by 41
  8. 2024PyTorch Frame: A Modular Framework for Multi-Modal Tabular Learningcited by 32
  9. 2025ConTextTab: A Semantics-Aware Tabular In-Context Learnercited by 31
  10. 2025FoNE: Precise Single-Token Number Embeddings via Fourier Featurescited by 21
  11. 2024GraphAlign: Pretraining One Graph Neural Network on Multiple Graphs via Feature Alignmentcited by 15
  12. 2024GraphFM: A generalist graph transformer that learns transferable representations across diverse domainscited by 14
1 more
  1. 2024PORTAL: Scalable Tabular Foundation Models via Content-Specific Tokenizationcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.