mlsanityData to 7 Oct 2026

Graph Neural Network contextual embedding for Deep Learning on Tabular Data

arXiv 2303.06455 ↗First posted 11 Mar 2023cs.LG cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

All industries are trying to leverage Artificial Intelligence (AI) based on their existing big data which is available in so called tabular form, where each record is composed of a number of heterogeneous continuous and categorical columns also known as features. Deep Learning (DL) has constituted a major breakthrough for AI in fields related to human skills like natural language processing, but its applicability to tabular data has been more challenging. More classical Machine Learning (ML) models like tree-based ensemble ones usually perform better. This paper presents a novel DL model using Graph Neural Network (GNN) more specifically Interaction Network (IN), for contextual embedding and modelling interactions among tabular features. Its results outperform those of a recently published survey with DL benchmark based on five public datasets, also achieving competitive results when compared to boosted-tree solutions.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 29 of its 54 references that are in the map. First posted on arXiv 11 Mar 2023.

Builds on

29 of 54 references.

References · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  6. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  7. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  8. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  9. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  10. 2017Neural Collaborative Filteringcited by 1,108
  11. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  12. 2020Efficient Transformers: A Surveycited by 784
17 more
  1. 2016Wide & Deep Learning for Recommender Systemscited by 745
  2. 2021Revisiting Deep Learning Models for Tabular Datacited by 725
  3. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
  4. 2019TabNet: Attentive Interpretable Tabular Learningcited by 640
  5. 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 516
  6. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
  7. 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
  8. 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 398
  9. 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 373
  10. 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
  11. 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 326
  12. 2021SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Trainingcited by 310
  13. 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 261
  14. 2017Distilling a Neural Network Into a Soft Decision Treecited by 230
  15. 2019Neural Oblivious Decision Ensembles for Deep Learning on Tabular Datacited by 200
  16. 2020Supervised Learning on Relational Databases with Graph Neural Networkscited by 48
  17. 2021TabGNN: Multiplex Graph Neural Network for Tabular Data Predictioncited by 26

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 2; 2025: 5.

8 papers.

  1. 2024Graph Neural Networks for Tabular Data Learning: A Survey with Taxonomy and Directionscited by 13
  2. 2023Domain-Guided Conditional Diffusion Model for Unsupervised Domain Adaptationcited by 9
  3. 2025TabGLM: Tabular Graph Language Model for Learning Transferable Representations Through Multi-Modal Consistency Minimizationcited by 2
  4. 2025RCCFormer: A Robust Crowd Counting Network Based on Transformercited by 1
  5. 2024Tokenize features, enhancing tables: the FT-TABPFN model for tabular classificationcited by 0
  6. 2025Quantum-Informed Contrastive Learning with Dynamic Mixup Augmentation for Class-Imbalanced Expert Systemscited by 0
  7. 2025Universal Embeddings of Tabular Datacited by 0
  8. 2025The Role of Feature Interactions in Graph-based Tabular Deep Learningcited by 0