mlsanityData to 7 Oct 2026

WorkRB: A Community-Driven Evaluation Framework for AI in the Work Domain

arXiv 2604.13055 ↗First posted 17 Mar 2026cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Today's evolving labor markets rely increasingly on recommender systems for hiring, talent management, and workforce analytics, with natural language processing (NLP) capabilities at the core. Yet, research in this area remains highly fragmented. Studies employ divergent ontologies (ESCO, O*NET, national taxonomies), heterogeneous task formulations, and diverse model families, making cross-study comparison and reproducibility exceedingly difficult. General-purpose benchmarks lack coverage of work-specific tasks, and the inherent sensitivity of employment data further limits open evaluation. We present WorkRB (Work Research Benchmark), the first open-source, community-driven benchmark tailored to work-domain AI. WorkRB organizes 13 diverse tasks from 7 task groups as unified recommendation and NLP tasks, including job/skill recommendation, candidate recommendation, similar item recommendation, and skill extraction and normalization. WorkRB enables both monolingual and cross-lingual evaluation settings through dynamic loading of multilingual ontologies. Developed within a multi-stakeholder ecosystem of academia, industry, and public institutions, WorkRB has a modular design for seamless contributions and enables integration of proprietary tasks without disclosing sensitive data. WorkRB is available under the Apache 2.0 license at https://github.com/techwolf-ai/WorkRB.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

16 of 25 references.

References · 16

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  3. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  4. 2022MTEB: Massive Text Embedding Benchmarkcited by 623
  5. 2023Fairness and Bias in Algorithmic Hiring: a Multidisciplinary Surveycited by 30
  6. 2021JobBERT: Understanding Job Titles through Skillscited by 29
  7. 2022Design of Negative Sampling Strategies for Distantly Supervised Skill Extractioncited by 16
  8. 2022Learning Job Titles Similarity from Noisy Skill Labelscited by 12
  9. 2024JOBSKAPE: A Framework for Generating Synthetic Job Postings to Enhance Skill Matchingcited by 11
  10. 2024MELO: An Evaluation Benchmark for Multilingual Entity Linking of Occupationscited by 6
  11. 2025Efficient Text Encoders for Labor Market Analysiscited by 5
  12. 2024SkillMatch: Evaluating Self-supervised Learning of Skill Relatednesscited by 4
4 more
  1. 2025Multilingual JobBERT for Cross-Lingual Job Title Matchingcited by 4
  2. 2024Skill matching at scale: freelancer-project alignment for efficient multilingual candidate retrievalcited by 2
  3. 2025Unified Work Embeddings: Contrastive Learning of a Bidirectional Multi-task Rankercited by 1
  4. 2026An Efficient Long-Context Ranking Architecture With Calibrated LLM Distillation: Application to Person-Job Fitcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.