Best Practices for Managing Data Annotation Projects
Not on the map. Why?
Abstract (arXiv)
Annotation is the labeling of data by human effort. Annotation is critical to modern machine learning, and Bloomberg has developed years of experience of annotation at scale. This report captures a wealth of wisdom for applied annotation projects, collected from more than 30 experienced annotation project managers in Bloomberg's Global Data department.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 3; 2024: 3; 2025: 4.
12 papers.
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2022Experimental Standards for Deep Learning in Natural Language Processing Researchcited by 9
- 2024MCRanker: Generating Diverse Criteria On-the-Fly to Improve Point-wise LLM Rankerscited by 7
- 2025LLMs as Span Annotators: A Comparative Study of LLMs and Humanscited by 7
- 2025Automatic Labelling with Open-source LLMs using Dynamic Label Schema Integrationcited by 5
- 2024Hands-On Tutorial: Labeling with LLM and Human-in-the-Loopcited by 2
- 2025Overcoming Language Barriers: Multilingual Analysis of the 2023 Swiss Privacy Law's Impactcited by 1
- 2025CAPC-CG: A Large-Scale, Expert-Directed LLM-Annotated Corpus of Adaptive Policy Communication in Chinacited by 1
- 2021We Need to Talk About Data: The Importance of Data Readiness in Natural Language Processingcited by 0
- 2023Generalizable Error Modeling for Human Data Annotation: Evidence From an Industry-Scale Search Data Annotation Programcited by 0
- 2023Abusive Span Detection for Vietnamese Narrative Textscited by 0
- 2024Designing A Sustainable Marine Debris Clean-up Framework without Human Labelscited by 0
- 2025CAPC-CG: A Large-Scale, Expert-Directed LLM-Annotated Corpus of Adaptive Policy Communication in China10 Oct 2025
- 2025Overcoming Language Barriers: Multilingual Analysis of the 2023 Swiss Privacy Law's Impact7 Oct 2025
- 2025LLMs as Span Annotators: A Comparative Study of LLMs and Humans11 Apr 2025
- 2025Automatic Labelling with Open-source LLMs using Dynamic Label Schema Integration21 Jan 2025
- 2024Hands-On Tutorial: Labeling with LLM and Human-in-the-Loop7 Nov 2024
- 2024Designing A Sustainable Marine Debris Clean-up Framework without Human Labels23 May 2024
- 2024MCRanker: Generating Diverse Criteria On-the-Fly to Improve Point-wise LLM Rankers18 Apr 2024
- 2023Abusive Span Detection for Vietnamese Narrative Texts13 Dec 2023
- 2023Generalizable Error Modeling for Human Data Annotation: Evidence From an Industry-Scale Search Data Annotation Program8 Oct 2023
- 2023BloombergGPT: A Large Language Model for Finance30 Mar 2023
- 2022Experimental Standards for Deep Learning in Natural Language Processing Research13 Apr 2022
- 2021We Need to Talk About Data: The Importance of Data Readiness in Natural Language Processing11 Oct 2021