mlsanityData to 14 Oct 2026

Modern Neural Networks for Small Tabular Datasets: The New Default for Field-Scale Digital Soil Mapping?

arXiv 2508.09888 ↗First posted 13 Aug 2025cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

In the field of pedometrics, tabular machine learning is the predominant method for soil property prediction from remote and proximal soil sensing data, forming a central component of Digital Soil Mapping (DSM). At the field-scale, this predictive soil modeling (PSM) task is typically constrained by small training sample sizes and high feature-to-sample ratios in soil spectroscopy. Traditionally, these conditions have proven challenging for conventional deep learning methods. Classical machine learning algorithms, particularly tree-based models like Random Forest and linear models such as Partial Least Squares Regression, have long been the default choice for pedometric modeling within DSM. Recent advances in artificial neural networks (ANN) for tabular data challenge this view, yet their suitability for field-scale DSM has not been proven. We introduce a comprehensive benchmark that evaluates state-of-the-art ANN architectures, including the latest multilayer perceptron (MLP)-based models (TabM, RealMLP), attention-based transformer variants (FT-Transformer, ExcelFormer, T2G-Former, AMFormer), retrieval-augmented approaches (TabR, ModernNCA), and an in-context learning foundation model (TabPFN). Our evaluation encompasses 31 field- and farm-scale datasets containing 30-460 soil samples and three critical soil properties: soil organic matter or soil organic carbon, pH, and clay content. Our results reveal that modern ANNs consistently outperform classical methods on the majority of tasks, demonstrating that deep learning has matured sufficiently to overcome the long-standing dominance of classical machine learning in pedometrics. Notably, TabPFN delivers the strongest overall performance, showing robustness across varying conditions. We therefore recommend the adoption of modern ANNs for field-scale DSM and propose TabPFN as the new default choice in the toolkit of every pedometrician.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 36 of its 83 references that are in the map. First posted on arXiv 13 Aug 2025.

Builds on

36 of 83 references.

References · 36

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  4. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  5. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  6. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  7. 2021Revisiting Deep Learning Models for Tabular Datacited by 740
  8. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 674
  9. 2019TabNet: Attentive Interpretable Tabular Learningcited by 648
  10. 2021Tabular Data: Deep Learning is Not All You Needcited by 535
  11. 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 320
  12. 2020Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learningcited by 297
24 more
  1. 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 289
  2. 2023When Do Neural Nets Outperform Boosted Trees on Tabular Data?cited by 223
  3. 2022On Embeddings for Numerical Features in Tabular Deep Learningcited by 186
  4. 2025TabArena: A Living Benchmark for Machine Learning on Tabular Datacited by 176
  5. 2024TabM: Advancing Tabular Deep Learning with Parameter-Efficient Ensemblingcited by 113
  6. 2024Better by Default: Strong Pre-Tuned MLPs and Boosted Trees on Tabular Datacited by 92
  7. 2018Hyperparameters and Tuning Strategies for Random Forestcited by 84
  8. 2023TabR: Tabular Deep Learning Meets Nearest Neighbors in 2023cited by 74
  9. 2024Retrieval & Fine-Tuning for In-Context Tabular Modelscited by 59
  10. 2022T2G-Former: Organizing Tabular Features into Relation Graphs Promotes Heterogeneous Feature Interactioncited by 41
  11. 2024A Closer Look at Deep Learning Methods on Tabular Datasetscited by 41
  12. 2025A Closer Look at TabPFN v2: Understanding Its Strengths and Extending Its Capabilitiescited by 41
  13. 2024TabReD: Analyzing Pitfalls and Filling the Gaps in Tabular Deep Learning Benchmarkscited by 33
  14. 2024Revisiting Nearest Neighbor for Tabular Data: A Deep Tabular Baseline Two Decades Latercited by 30
  15. 2020Learnable Uncertainty under Laplace Approximationscited by 29
  16. 2019Learning Internal Representations (COLT 1995)cited by 25
  17. 2023Joint Training of Deep Ensembles Fails Due to Learner Collusioncited by 23
  18. 2023MotherNet: Fast Training and Inference via Hyper-Network Transformerscited by 19
  19. 2021Over-optimism in benchmark studies and the multiplicity of design and analysis options when interpreting their resultscited by 15
  20. 2024A Comprehensive Benchmark of Machine and Deep Learning Across Diverse Tabular Datasetscited by 15
  21. 2025On Finetuning Tabular Foundation Modelscited by 13
  22. 2024Arithmetic Feature Interaction Is Necessary for Deep Tabular Learningcited by 8
  23. 2024An Efficient Model-Agnostic Approach for Uncertainty Estimation in Data-Restricted Pedometric Applicationscited by 3
  24. 2025LimeSoDa: A Dataset Collection for Benchmarking of Machine Learning Regressors in Digital Soil Mappingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Multi-Modal Spatio-Temporal Graph Neural Network with Mixture of Experts for Soil Organic Carbon Prediction
  2. 2025Product Quantization for Surface Soil Similarity
  3. 2024A text-based, generative deep learning model for soil reflectance spectrum simulation in the VIS-NIR (400-2499 nm) bands
  4. 2026Task-Conditioned Synthetic Data Generation for Improving Machine Learning Performance in Agricultural Prediction Tasks
  5. 2026Physically Interpretable AlphaEarth Foundation Model Embeddings Enable LLM-Based Land Surface Intelligence
  6. 2025A large-scale image-text dataset benchmark for farmland segmentation
  7. 2023When Geoscience Meets Foundation Models: Towards General Geoscience Artificial Intelligence System
  8. 2024Mambular: A Sequential Model for Tabular Deep Learning