# LayoutBench: Performance Benchmarking of Cloud Storage Layouts for Multimedia Data

arXiv: https://arxiv.org/abs/2607.28880 · HTML: https://mlsanity.com/paper/2607.28880/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 14 of its 42 references that are in the map.
- First posted on arXiv 30 Jul 2026.

## Builds on (most cited first, 14 of 14)

- [InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generation](https://mlsanity.com/paper/2307.06942/) (2023)
- [Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs](https://mlsanity.com/paper/2406.20098/) (2024)
- [MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Dataset](https://mlsanity.com/paper/2202.11684/) (2022)
- [Survey of Vector Database Management Systems](https://mlsanity.com/paper/2310.14021/) (2023)
- [High Performance I/O For Large Scale Deep Learning](https://mlsanity.com/paper/2001.01858/) (2020)
- [Data Lakes: A Survey of Functions and Systems](https://mlsanity.com/paper/2106.09592/) (2021)
- [Deep Lake: a Lakehouse for Deep Learning](https://mlsanity.com/paper/2209.10785/) (2022)
- [Shop The Look: Building a Large Scale Visual Shopping System at Pinterest](https://mlsanity.com/paper/2006.10866/) (2020)
- [Lance: Efficient Random Access in Columnar Storage through Adaptive Structural Encodings](https://mlsanity.com/paper/2504.15247/) (2025)
- [An Empirical Evaluation of Columnar Storage Formats](https://mlsanity.com/paper/2304.05028/) (2023)
- [Pareto-Secure Machine Learning (PSML): Fingerprinting and Securing Inference Serving Systems](https://mlsanity.com/paper/2307.01292/) (2023)
- [Benchmarking Analytical Query Processing in Intel SGXv2](https://mlsanity.com/paper/2403.11874/) (2024)
- [Diagnosing and Resolving Cloud Platform Instability with Multi-modal RAG LLMs](https://mlsanity.com/paper/2505.21419/) (2025)
- [KLAS: Using Similarity to Stitch Neural Networks for Improved Accuracy-Efficiency Tradeoffs](https://mlsanity.com/paper/2605.29259/) (2026)

## Abstract (arXiv)

Modern multimedia machine learning workloads increasingly store large-scale datasets in cloud object storage services such as AWS S3. How these samples are physically organized in storage (i.e.,storage layout) directly affects how quickly and cheaply they can be retrieved. Yet the benchmarks used to guide storage decisions today focus on database engines and query processing, and none systematically evaluates how different storage layouts perform for multimedia data retrieval. We present LayoutBench, the first benchmark designed to fill this gap. It evaluates three representative layout strategies: storing each sample as an individual object (L1), sequentially packing samples into tar archives (L2), and organizing samples as columns in Parquet files (L3). We measure retrieval time, data transferred, and monetary cost using 11 queries of varying result-set sizes on ImageNet across six AWS EC2 instance configurations that span different network bandwidth and memory tiers. Our experiments reveal that L2 achieves lower latency than L1 and L3 through connection reuse, but loses this advantage as retrieval sizes become very large. L3 is the fastest for very large retrievals but transfers substantially more data across all query sizes due to row-group granularity, and requires significantly more memory. Across all layouts, data transfer cost dominates total expenditure, with L3 costing an order of magnitude more than L1 or L2.