# WorkRB: A Community-Driven Evaluation Framework for AI in the Work Domain

arXiv: https://arxiv.org/abs/2604.13055 · HTML: https://mlsanity.com/paper/2604.13055/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 16 of its 25 references that are in the map.
- First posted on arXiv 17 Mar 2026.

## Builds on (most cited first, 16 of 16)

- [Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks](https://mlsanity.com/paper/1908.10084/) (2019)
- [Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models](https://mlsanity.com/paper/2506.05176/) (2025)
- [BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models](https://mlsanity.com/paper/2104.08663/) (2021)
- [MTEB: Massive Text Embedding Benchmark](https://mlsanity.com/paper/2210.07316/) (2022)
- [Fairness and Bias in Algorithmic Hiring: a Multidisciplinary Survey](https://mlsanity.com/paper/2309.13933/) (2023)
- [JobBERT: Understanding Job Titles through Skills](https://mlsanity.com/paper/2109.09605/) (2021)
- [Design of Negative Sampling Strategies for Distantly Supervised Skill Extraction](https://mlsanity.com/paper/2209.05987/) (2022)
- [Learning Job Titles Similarity from Noisy Skill Labels](https://mlsanity.com/paper/2207.00494/) (2022)
- [JOBSKAPE: A Framework for Generating Synthetic Job Postings to Enhance Skill Matching](https://mlsanity.com/paper/2402.03242/) (2024)
- [MELO: An Evaluation Benchmark for Multilingual Entity Linking of Occupations](https://mlsanity.com/paper/2410.08319/) (2024)
- [Efficient Text Encoders for Labor Market Analysis](https://mlsanity.com/paper/2505.24640/) (2025)
- [SkillMatch: Evaluating Self-supervised Learning of Skill Relatedness](https://mlsanity.com/paper/2410.05006/) (2024)
- [Multilingual JobBERT for Cross-Lingual Job Title Matching](https://mlsanity.com/paper/2507.21609/) (2025)
- [Skill matching at scale: freelancer-project alignment for efficient multilingual candidate retrieval](https://mlsanity.com/paper/2409.12097/) (2024)
- [Unified Work Embeddings: Contrastive Learning of a Bidirectional Multi-task Ranker](https://mlsanity.com/paper/2511.07969/) (2025)
- [An Efficient Long-Context Ranking Architecture With Calibrated LLM Distillation: Application to Person-Job Fit](https://mlsanity.com/paper/2601.10321/) (2026)

## Built on by (most cited first, 2 of 2)

- [Overview of the TalentCLEF 2026: Skill and Job Title Intelligence for Human Capital Management](https://mlsanity.com/paper/2606.31692/) (2026)
- [EHR-Bench: A Chinese Multi-Task Benchmark for Recruitment AI](https://mlsanity.com/paper/2610.16689/) (2026)

## Abstract (arXiv)

Today's evolving labor markets rely increasingly on recommender systems for hiring, talent management, and workforce analytics, with natural language processing (NLP) capabilities at the core. Yet, research in this area remains highly fragmented. Studies employ divergent ontologies (ESCO, O*NET, national taxonomies), heterogeneous task formulations, and diverse model families, making cross-study comparison and reproducibility exceedingly difficult. General-purpose benchmarks lack coverage of work-specific tasks, and the inherent sensitivity of employment data further limits open evaluation. We present WorkRB (Work Research Benchmark), the first open-source, community-driven benchmark tailored to work-domain AI. WorkRB organizes 13 diverse tasks from 7 task groups as unified recommendation and NLP tasks, including job/skill recommendation, candidate recommendation, similar item recommendation, and skill extraction and normalization. WorkRB enables both monolingual and cross-lingual evaluation settings through dynamic loading of multilingual ontologies. Developed within a multi-stakeholder ecosystem of academia, industry, and public institutions, WorkRB has a modular design for seamless contributions and enables integration of proprietary tasks without disclosing sensitive data. WorkRB is available under the Apache 2.0 license at https://github.com/techwolf-ai/WorkRB.