Modeling Decisions in Blockchain Analytics: A Leakage-Aware Evaluation of Tree-Based vs. Sequential Models
Not on the map. Why?
Abstract (arXiv)
Sybil bots are Ethereum actors that imitate legitimate users to extract airdrop rewards or influence governance. Recent Sybil detection methods increasingly use deep learning and treat blockchain activity as a quasi-linguistic sequence. However, complex sequence models are computationally expensive for real-time monitoring, and their reported performance may be inflated by label leakage from high-signal smart contracts. We ask whether and how organic users, Sybil bots, and MEV bots differ in the structural complexity of their transaction histories; whether sequential models outperform tree-based tabular models once leakage is reduced; whether transaction order or timing provides the stronger behavioral signal; and whether the resulting models are practical for low-latency deployment. Our approach to leakage-aware Sybil bot detection consists of a Blind-Spot protocol and a Transaction Grammar representation of wallet behavior. The former eliminates shortcuts associated with high-signal contracts, whereas the latter models wallets using rhythm, EVM execution structure, and intent. We evaluate this approach on Ethereum actor classification by comparing Transformer and BiLSTM sequence models against XGBoost and SVM baselines. We contribute a framework for leakage-aware Ethereum actor classification and a Transaction Grammar representation of wallet behavior. Our results demonstrate that, under leakage-aware evaluation, XGBoost outperforms Transformer-based sequence models while providing lower latency and estimated energy use.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 25 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
20 of 25 references.
References · 20
- 2017Attention Is All You Needcited by 60,361
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
- 2021Revisiting Deep Learning Models for Tabular Datacited by 740
- 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 674
- 2019Green AIcited by 627
- 2021Tabular Data: Deep Learning is Not All You Needcited by 535
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 491
- 2021SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Trainingcited by 319
- 2024Ethereum Fraud Detection via Joint Transaction Language Model and Graph Representation Learningcited by 8
8 more
- 2024Detecting Financial Bots on the Ethereum Blockchaincited by 6
- 2025Applying Informer for Option Pricing: A Transformer-Based Approachcited by 5
- 2024Maximal Extractable Value in Decentralized Finance: Taxonomy, Detection, and Mitigationcited by 4
- 2025Detecting Sybil Addresses in Blockchain Airdrops: A Subgraph-based Feature Propagation and Fusion Approachcited by 4
- 2024The Role of Transformer Models in Advancing Blockchain Technology: A Systematic Surveycited by 3
- 2025On Evaluating Loss Functions for Stock Ranking: An Empirical Analysis With Transformer Modelcited by 3
- 2025Partial multivariate transformer as a tool for cryptocurrencies time series predictioncited by 3
- 2023Airdrops: Giving Money Away Is Harder Than It Seemscited by 2
Built on by
Not cited yet.