# Redbench: A Benchmark Reflecting Real Workloads

arXiv: https://arxiv.org/abs/2506.12488 · HTML: https://mlsanity.com/paper/2506.12488/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Jun 2025.

## Built on by (most cited first, 1 of 1)

- [Adversarial Query Synthesis via Bayesian Optimization](https://mlsanity.com/paper/2603.01570/) (2026)

## Abstract (arXiv)

Instance-optimized components have made their way into production systems. To some extent, this adoption is due to the characteristics of customer workloads, which can be individually leveraged during the model training phase. However, there is a gap between research and industry that impedes the development of realistic learned components: the lack of suitable workloads. Existing ones, such as TPC-H and TPC-DS, and even more recent ones, such as DSB and CAB, fail to exhibit real workload patterns, particularly distribution shifts. In this paper, we introduce Redbench, a collection of 30 workloads that reflect query patterns observed in the real world. The workloads were obtained by sampling queries from support benchmarks and aligning them with workload characteristics observed in Redset.