mlsanityData to 14 Oct 2026

InRTL: Effective Intra-Inter Interaction Learning for Relational Tables

arXiv 2609.12712 ↗First posted 11 Sep 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Relational table learning has recently emerged as an important research direction for modeling multiple tables connected through primary key-foreign key (PK-FK) relationships. Despite recent advances, a principled modeling framework tailored to this task remains underexplored. In this paper, we propose Intra-Inter Relational Table Learning (InRTL), a unified framework that explicitly models dependencies both within and across relational tables. Specifically, InRTL formalizes two complementary interaction patterns: intra-table interactions, describing associations among rows within the same table, and inter-table interactions, describing dependencies between rows across PK-FK-linked tables. To model these dependencies, we develop a column-aware table encoder to generate initial row representations, followed by Transformer-based self-attention and cross-attention modules for intra-table and inter-table learning, respectively. To further improve scalability, InRTL incorporates linearized attention and heterogeneous graph neural networks to simplify the self-attention and cross-attention operations. Extensive experiments on ten datasets covering 24 real-world tasks demonstrate the effectiveness of our approach. Code is available at https://github.com/W1nterFloW/InRTL.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 35 references that are in the map. First posted on arXiv 11 Sep 2026.

Builds on

27 of 35 references.

References · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  5. 2016Identity Mappings in Deep Residual Networkscited by 1,965
  6. 2020Rethinking Attention with Performerscited by 1,601
  7. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  8. 2021Revisiting Deep Learning Models for Tabular Datacited by 740
  9. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 674
  10. 2019TabNet: Attentive Interpretable Tabular Learningcited by 648
  11. 2021Deep Neural Networks and Tabular Data: A Surveycited by 491
  12. 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 409
15 more
  1. 2021SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Trainingcited by 319
  2. 2020MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformerscited by 245
  3. 2022Pure Transformers are Powerful Graph Learnerscited by 188
  4. 2022On Embeddings for Numerical Features in Tabular Deep Learningcited by 186
  5. 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
  6. 2022TransTab: Learning Transferable Tabular Transformers Across Tablescited by 132
  7. 2024RelBench: A Benchmark for Deep Learning on Relational Databasescited by 96
  8. 2025RelGNN: Composite Message Passing for Relational Deep Learningcited by 48
  9. 2023Trompt: Towards a Better Deep Neural Network for Tabular Datacited by 36
  10. 2025Boosting Relational Deep Learning with Pretrained Tabular Modelscited by 9
  11. 2024rLLM: Relational Table Learning with LLMscited by 7
  12. 2023From Cluster Assumption to Graph Convolution: Graph-based Semi-Supervised Learning Revisitedcited by 6
  13. 2024Survey on Semantic Interpretation of Tabular Data: Challenges and Directionscited by 3
  14. 2026LakeMLB: Data Lake Machine Learning Benchmarkcited by 3
  15. 2026TLSQL: Table Learning Structured Query Languagecited by 2

Built on by

Not cited yet.