Breaking the HISCO Barrier: Automatic Occupational Standardization with OccCANINE
Not on the map. Why?
Abstract (arXiv)
This paper introduces OccCANINE, an open-source tool that maps occupational descriptions to HISCO codes. Manual coding is slow and error-prone; OccCANINE replaces weeks of work with results in minutes. We fine-tune CANINE on 15.8 million description-code pairs from 29 sources in 13 languages. The model achieves 96 percent accuracy, precision, and recall. We also show that the approach generalizes to three systems - OCC1950, OCCICEM, and ISCO-68 - and release them open source. By breaking the "HISCO barrier," OccCANINE democratizes access to high-quality occupational coding, enabling broader research in economics, economic history, and related disciplines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 3 of its 42 references that are in the map. First posted on arXiv 21 Feb 2024.
Builds on
3 of 42 references.
References · 3
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
Built on by
Not cited yet.