Application of machine learning to monster level prediction in tabletop RPG game design
Not on the map. Why?
Abstract (arXiv)
Designing balanced adversaries is a central but labor-intensive task in tabletop role-playing game (TTRPG) development. In systems such as Pathfinder, each monster is described by many numerical attributes that jointly determine its power, summarized as an ordinal level. We investigate whether machine learning can support designers by predicting this level from a monster's attributes, framing the task as tabular ordinal regression. We introduce what is, to our knowledge, the first dataset built specifically for TTRPG monster-level prediction, derived from publicly available Pathfinder Second Edition data. Using it, we compare classical regression models with rounding schemes, dedicated tabular ordinal regression algorithms, and neural networks with ordinal-aware losses. To mirror real design workflows, we evaluate all models under chronological and expanding-window protocols with several complementary metrics. Results show that tree-based ensembles outperform linear models and neural approaches, achieving near-perfect ordinal ranking and high predictive accuracy. Explainable AI analyses, such as feature importance and error distributions, show that the model is aligned with human intuition and follows patterns grounded in game rules. Together, these results show that machine learning can reliably approximate designer judgments and serve as an effective computer-aided tool for monster balancing and broader TTRPG system design.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 57 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
14 of 57 references.
References · 14
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2023Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performancecited by 143
- 2016GPflow: A Gaussian process library using TensorFlowcited by 139
- 2017Procedural Content Generation via Machine Learning (PCGML)cited by 136
- 2019Rank consistent ordinal regression for neural networks with application to age estimationcited by 132
- 2018Hyperparameters and Tuning Strategies for Random Forestcited by 83
- 2020Deep Learning for Procedural Content Generationcited by 73
- 2021Deep Neural Networks for Rank-Consistent Ordinal Regression Based On Conditional Probabilitiescited by 57
- 2022Moving Window Regression: A Novel Approach to Ordinal Regressioncited by 44
- 2014On the Consistency of Ordinal Regression Methodscited by 24
- 2018Automated Game Design via Conceptual Expansioncited by 15
- 2020Towards Game Design via Creative Machine Learning (GDCML)cited by 12
2 more
Built on by
Not cited yet.