mlsanityData to 14 Oct 2026

A step towards the integration of machine learning and classic model-based survey methods

arXiv 2402.07521 ↗First posted 12 Feb 2024stat.ME econ.EM stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

The usage of machine learning methods in traditional surveys including official statistics, is still very limited. Therefore, we propose a predictor supported by these algorithms, which can be used to predict any population or subpopulation characteristics. Machine learning methods have already been shown to be very powerful in identifying and modelling complex and nonlinear relationships between the variables, which means they have very good properties in case of strong departures from the classic assumptions. Therefore, we analyse the performance of our proposal under a different set-up, which, in our opinion, is of greater importance in real-life surveys. We study only small departures from the assumed model to show that our proposal is a good alternative, even in comparison with optimal methods under the model. Moreover, we propose the method of the ex ante accuracy estimation of machine learning predictors, giving the possibility of the accuracy comparison with classic methods. The solution to this problem is indicated in the literature as one of the key issues in integrating these approaches. The simulation studies are based on a real, longitudinal dataset, where the prediction of subpopulation characteristics is considered.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 7 of its 67 references that are in the map. First posted on arXiv 12 Feb 2024.

Builds on

7 of 67 references.

References · 7

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  2. 2020Kaggle forecasting competitions: An overlooked learning opportunitycited by 56
  3. 2020Interpretable Poverty Mapping using Social Media Data, Satellite Images, and Geospatial Informationcited by 8
  4. 2021Improving the output quality of official statistics based on machine learning algorithmscited by 5
  5. 2020Model-assisted estimation through random forests in finite population samplingcited by 4
  6. 2013New Important Developments in Small Area Estimationcited by 3
  7. 2022Flexible domain prediction using mixed effects random forestscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.