mlsanityData to 14 Oct 2026

Revisiting Energy-based Tabular Anomaly Detection: Energy and Reconstruction are Complementary

arXiv 2608.14186 ↗First posted 14 Aug 2026cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Tabular anomaly detection is dominated by classical density-proxy methods (Isolation Forest, OCSVM, LOF), reconstruction-based detectors (Autoencoders, VAEs), and modern non-parametric scorers (COPOD, ECOD, Deep SVDD), all of which approximate the inlier distribution only indirectly; explicit energy-based models are largely absent. Motivated by the recent revival of EBMs in deep learning (e.g., Energy-Based Transformers, JEPA), we revisit the classical Deep Boltzmann Machine (DBM) for this task and hypothesize that its mean-field energy combines more effectively with a reconstruction-based score than same-lineage pairs do. We evaluate a two-hidden-layer DBM on two tabular benchmarks spanning distinct domains (UCI Bank Marketing and NSL-KDD) against eight classical and modern baselines across twenty random seeds. The DBM mean-field energy matches the strongest baseline (the Autoencoder) on Bank Marketing and statistically beats it on NSL-KDD, while significantly outperforming the remaining seven on both datasets. When fused with the Autoencoder via rank fusion, the DBM energy yields a statistically significant improvement on both datasets (AUROC=+0.014, p<0.01 on Bank Marketing; +0.002, p<0.001 on NSL-KDD); every non-DBM-derived base model instead fails to improve or significantly degrades the AE-paired ensemble. Our position is that classical EBMs, exemplified by the DBM, deserve a place in the tabular anomaly detection toolbox as a non-redundant complementary view to the reconstruction-based scores that dominate current practice.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 34 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

15 of 34 references.

References · 15

  1. 2013Auto-Encoding Variational Bayescited by 4,053
  2. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  3. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  4. 2018Do Deep Generative Models Know What They Don't Know?cited by 443
  5. 2021How to Train Your Energy-Based Modelscited by 274
  6. 2022ADBench: Anomaly Detection Benchmarkcited by 232
  7. 2019PyOD: A Python Toolbox for Scalable Outlier Detectioncited by 222
  8. 2022ECOD: Unsupervised Outlier Detection Using Empirical Cumulative Distribution Functionscited by 153
  9. 2020COPOD: Copula-Based Outlier Detectioncited by 146
  10. 2016Deep Structured Energy Based Models for Anomaly Detectioncited by 114
  11. 2023On Diffusion Modeling for Anomaly Detectioncited by 72
  12. 2025Energy-Based Transformers are Scalable Learners and Thinkerscited by 31
3 more
  1. 2023Beyond Individual Input for Deep Anomaly Detection on Tabular Datacited by 16
  2. 2026The Mouth is Not the Brain: Bridging Energy-Based World Models and Language Generationcited by 1
  3. 2026Three-in-One World Model: Energy-Based Consistency, Prediction, and Counterfactual Inference for Marketing Interventioncited by 1

Built on by

Not cited yet.