GANDALF: Gated Adaptive Network for Deep Automated Learning of Features
Not on the map. Why?
Abstract (arXiv)
We propose a novel high-performance, interpretable, and parameter & computationally efficient deep learning architecture for tabular data, Gated Adaptive Network for Deep Automated Learning of Features (GANDALF). GANDALF relies on a new tabular processing unit with a gating mechanism and in-built feature selection called Gated Feature Learning Unit (GFLU) as a feature representation learning unit. We demonstrate that GANDALF outperforms or stays at-par with SOTA approaches like XGBoost, SAINT, FT-Transformers, etc. by experiments on multiple established public benchmarks. We have made available the code at github.com/manujosephv/pytorchtabular under MIT License.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 22 of its 49 references that are in the map. First posted on arXiv 18 Jul 2022.
Builds on
22 of 49 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2021Revisiting Deep Learning Models for Tabular Datacited by 725
- 2016Language Modeling with Gated Convolutional Networkscited by 688
- 2019TabNet: Attentive Interpretable Tabular Learningcited by 640
- 2017Convolutional Sequence to Sequence Learningcited by 550
- 2021Tabular Data: Deep Learning is Not All You Needcited by 530
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
10 more
- 2016From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classificationcited by 337
- 2015Highway Networkscited by 257
- 2019Neural Oblivious Decision Ensembles for Deep Learning on Tabular Datacited by 200
- 2017OpenML Benchmarking Suitescited by 169
- 2019Sparse Sequence-to-Sequence Modelscited by 167
- 2019Sanity Checks for Saliency Metricscited by 119
- 2021DANets: Deep Abstract Networks for Tabular Data Classification and Regressioncited by 50
- 2021PyTorch Tabular: A Framework for Deep Learning with Tabular Datacited by 20
- 2018Feature Selection using Stochastic Gatescited by 12
- 2020Feature Selection Using Batch-Wise Attenuation and Feature Mask Normalizationcited by 11
Built on by
Citing papers per year: 2023: 2; 2024: 4; 2025: 2; 2026: 1.
9 papers.
- 2023UniTabE: A Universal Pretraining Protocol for Tabular Foundation Model in Data Sciencecited by 28
- 2024Unlock the Potential of Large Language Models for Predictive Tabular Tasks in Data Science with Table-Specific Pretrainingcited by 12
- 2024Fault Detection for agents on power grid topology optimization: A Comprehensive analysiscited by 2
- 2023An Epistemic and Aleatoric Decomposition of Arbitrariness to Constrain the Set of Good Modelscited by 1
- 2024TRACE: Transformer-based Risk Assessment for Clinical Evaluationcited by 1
- 2024Iterative Feature Exclusion Ranking for Deep Tabular Learningcited by 0
- 2025VirnyFlow: Optimizing ML Pipelines for Accuracy, Fairness, and Stability at Scalecited by 0
- 2025SG-XDEAT: Sparsity-Guided Cross-Dimensional and Cross-Encoding Attention with Target-Aware Conditioning in Tabular Learningcited by 0
- 2026Structural Compositional Function Networks: Interpretable Functional Compositions for Tabular Discoverycited by 0
- 2026Structural Compositional Function Networks: Interpretable Functional Compositions for Tabular Discovery27 Jan 2026
- 2025SG-XDEAT: Sparsity-Guided Cross-Dimensional and Cross-Encoding Attention with Target-Aware Conditioning in Tabular Learning14 Oct 2025
- 2025VirnyFlow: Optimizing ML Pipelines for Accuracy, Fairness, and Stability at Scale2 Jun 2025
- 2024Iterative Feature Exclusion Ranking for Deep Tabular Learning21 Dec 2024
- 2024TRACE: Transformer-based Risk Assessment for Clinical Evaluation13 Nov 2024
- 2024Fault Detection for agents on power grid topology optimization: A Comprehensive analysis24 Jun 2024
- 2024Unlock the Potential of Large Language Models for Predictive Tabular Tasks in Data Science with Table-Specific Pretraining29 Mar 2024
- 2023UniTabE: A Universal Pretraining Protocol for Tabular Foundation Model in Data Science18 Jul 2023
- 2023An Epistemic and Aleatoric Decomposition of Arbitrariness to Constrain the Set of Good Models9 Feb 2023