# Towards mapping the contemporary art world with ArtLM: an art-specific NLP model

arXiv: https://arxiv.org/abs/2212.07127 · HTML: https://mlsanity.com/paper/2212.07127/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 17 of its 35 references that are in the map.
- First posted on arXiv 14 Dec 2022.

## Builds on (most cited first, 17 of 17)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [RoBERTa: A Robustly Optimized BERT Pretraining Approach](https://mlsanity.com/paper/1907.11692/) (2019)
- [Efficient Estimation of Word Representations in Vector Space](https://mlsanity.com/paper/1301.3781/) (2013)
- [DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter](https://mlsanity.com/paper/1910.01108/) (2019)
- [XLNet: Generalized Autoregressive Pretraining for Language Understanding](https://mlsanity.com/paper/1906.08237/) (2019)
- [Cross-lingual Language Model Pretraining](https://mlsanity.com/paper/1901.07291/) (2019)
- [FinBERT: Financial Sentiment Analysis with Pre-trained Language Models](https://mlsanity.com/paper/1908.10063/) (2019)
- [BERT for Coreference Resolution: Baselines and Analysis](https://mlsanity.com/paper/1908.09091/) (2019)
- [Neural Machine Translation: A Review and Survey](https://mlsanity.com/paper/1912.02047/) (2019)
- [The Shape of Art History in the Eyes of the Machine](https://mlsanity.com/paper/1801.07729/) (2018)
- [Stock Movement Prediction with Financial News using Contextualized Embedding from BERT](https://mlsanity.com/paper/2107.08721/) (2021)
- [Graph-Based Learning for Stock Movement Prediction with Textual and Relational Data](https://mlsanity.com/paper/2107.10941/) (2021)
- [Formal Analysis of Art: Proxy Learning of Visual Concepts from Style Through Language Models](https://mlsanity.com/paper/2201.01819/) (2022)
- [Natural Language Processing for Music Knowledge Discovery](https://mlsanity.com/paper/1807.02200/) (2018)
- [Exploring Content-based Artwork Recommendation with Metadata and Visual Features](https://mlsanity.com/paper/1706.05786/) (2017)
- [Docent: A content-based recommendation system to discover contemporary art](https://mlsanity.com/paper/2207.05648/) (2022)

## Abstract (arXiv)

With an increasing amount of data in the art world, discovering artists and artworks suitable to collectors' tastes becomes a challenge. It is no longer enough to use visual information, as contextual information about the artist has become just as important in contemporary art. In this work, we present a generic Natural Language Processing framework (called ArtLM) to discover the connections among contemporary artists based on their biographies. In this approach, we first continue to pre-train the existing general English language models with a large amount of unlabelled art-related data. We then fine-tune this new pre-trained model with our biography pair dataset manually annotated by a team of professionals in the art industry. With extensive experiments, we demonstrate that our ArtLM achieves 85.6% accuracy and 84.0% F1 score and outperforms other baseline models. We also provide a visualisation and a qualitative analysis of the artist network built from ArtLM's outputs.
