# Annotationsaurus: A Searchable Directory of Annotation Tools

arXiv: https://arxiv.org/abs/2010.06251 · HTML: https://mlsanity.com/paper/2010.06251/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Oct 2020.

## Built on by (most cited first, 2 of 2)

- [Mephisto: A Framework for Portable, Reproducible, and Iterative Crowdsourcing](https://mlsanity.com/paper/2301.05154/) (2023)
- [MEGAnno: Exploratory Labeling for NLP in Computational Notebooks](https://mlsanity.com/paper/2301.03095/) (2023)

## Abstract (arXiv)

Manual annotation of textual documents is a necessary task when constructing benchmark corpora for training and evaluating machine learning algorithms. We created a comprehensive directory of annotation tools that currently includes 93 tools. We analyzed the tools over a set of 31 features and implemented simple scripts and a Web application that filters the tools based on chosen criteria. We present two use cases using the directory and propose ideas for its maintenance. The directory, source codes for scripts, and link to the Web application are available at: https://github.com/mariananeves/annotation-tools