# ScrollTimes: Tracing the Provenance of Paintings as a Window into History

arXiv: https://arxiv.org/abs/2306.08834 · HTML: https://mlsanity.com/paper/2306.08834/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 13 of its 93 references that are in the map.
- First posted on arXiv 15 Jun 2023.

## Builds on (most cited first, 13 of 13)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Bootstrap your own latent: A new approach to self-supervised Learning](https://mlsanity.com/paper/2006.07733/) (2020)
- [Rethinking Atrous Convolution for Semantic Image Segmentation](https://mlsanity.com/paper/1706.05587/) (2017)
- [YOLOX: Exceeding YOLO Series in 2021](https://mlsanity.com/paper/2107.08430/) (2021)
- [StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding](https://mlsanity.com/paper/1908.04577/) (2019)
- [Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning](https://mlsanity.com/paper/2105.03654/) (2021)
- [XNLI: Explaining and Diagnosing NLI-based Visual Data Analysis](https://mlsanity.com/paper/2301.10385/) (2023)
- [Survey on Visual Analysis of Event Sequence Data](https://mlsanity.com/paper/2006.14291/) (2020)
- [Explaining with Examples: Lessons Learned from Crowdsourced Introductory Description of Information Visualizations](https://mlsanity.com/paper/2112.12364/) (2021)
- [Anchorage: Visual Analysis of Satisfaction in Customer Service Videos via Anchor Events](https://mlsanity.com/paper/2302.06806/) (2023)
- [TaxThemis: Interactive Mining and Exploration of Suspicious Tax Evasion Group](https://mlsanity.com/paper/2009.03179/) (2020)
- [CohortVA: A Visual Analytic System for Interactive Exploration of Cohorts based on Historical Data](https://mlsanity.com/paper/2208.09237/) (2022)
- [Towards an Understanding of Distributed Asymmetric Collaborative Visualization on Problem-solving](https://mlsanity.com/paper/2302.01966/) (2023)

## Built on by (most cited first, 3 of 3)

- [PromptMagician: Interactive Prompt Engineering for Text-to-Image Creation](https://mlsanity.com/paper/2307.09036/) (2023)
- [Prismatic: Interactive Multi-View Cluster Analysis of Concept Stocks](https://mlsanity.com/paper/2402.08978/) (2024)
- [VisTCP: A Visualization Framework to Construct Knowledge-Graph-Based Representation for Traditional Chinese Painting](https://mlsanity.com/paper/2607.05841/) (2026)

## Abstract (arXiv)

The study of cultural artifact provenance, tracing ownership and preservation, holds significant importance in archaeology and art history. Modern technology has advanced this field, yet challenges persist, including recognizing evidence from diverse sources, integrating sociocultural context, and enhancing interactive automation for comprehensive provenance analysis. In collaboration with art historians, we examined the handscroll, a traditional Chinese painting form that provides a rich source of historical data and a unique opportunity to explore history through cultural artifacts. We present a three-tiered methodology encompassing artifact, contextual, and provenance levels, designed to create a "Biography" for handscroll. Our approach incorporates the application of image processing techniques and language models to extract, validate, and augment elements within handscroll using various cultural heritage databases. To facilitate efficient analysis of non-contiguous extracted elements, we have developed a distinctive layout. Additionally, we introduce ScrollTimes, a visual analysis system tailored to support the three-tiered analysis of handscroll, allowing art historians to interactively create biographies tailored to their interests. Validated through case studies and expert interviews, our approach offers a window into history, fostering a holistic understanding of handscroll provenance and historical significance.