mlsanityData to 14 Oct 2026

EHR-Bench: A Chinese Multi-Task Benchmark for Recruitment AI

arXiv 2610.16689 ↗First posted 12 Oct 2026cs.CL cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Recruitment applications span diverse operations, from drafting job descriptions and interpreting queries to organizing profiles, assessing fit, and recommending candidates and jobs. Systematic LLM evaluation therefore requires task coverage that reflects this range of business needs. We introduce EHR-Bench, an open Chinese benchmark comprising twelve tasks across six capability families and five recruitment scenarios. The tasks cover generation, extraction, classification, retrieval, semantic similarity, and reciprocal ranking within one evaluation framework. An internal recruitment dataset guides task definitions, the occupation taxonomy and sampling targets, output requirements, and scoring protocols. Following these specifications, we construct 8,336 task instances from public materials and controlled augmentation, with source-aware expert review and documented provenance. We evaluate twelve LLMs through task-level, capability-level, and aggregate comparisons. Closely ranked models exhibit distinct task strengths, and performance varies across input sources, reference evidence, and candidate pools. Five shared models retain the same observed Overall ordering on a private operational reference, with variation in capability and task correspondence. EHR-Bench provides a reproducible foundation for systematic model assessment, task-specific model selection, and further research on LLMs for recruitment. The project repository is available at https://github.com/EhrBench/EHR-Bench.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

20 of 35 references.

References · 20

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2018Datasheets for Datasetscited by 1,386
  3. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
  4. 2022MTEB: Massive Text Embedding Benchmarkcited by 640
  5. 2019Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practicescited by 174
  6. 2022SkillSpan: Hard and Soft Skill Extraction from English Job Postingscited by 43
  7. 2018Enhancing Person-Job Fit for Talent Recruitment: An Ability-aware Neural Network Approachcited by 39
  8. 2020Learning to Match Jobs with Resumes from Sparse Interaction Data using Multi-View Co-Teaching Networkcited by 25
  9. 2025Evaluating Bias in LLMs for Job-Resume Matching: Gender, Race, and Educationcited by 14
  10. 2024JOBSKAPE: A Framework for Generating Synthetic Job Postings to Enhance Skill Matchingcited by 12
  11. 2020Competence-Level Prediction and Resume & Job Description Matching Using Context-Aware Transformer Modelscited by 11
  12. 2024Natural Language Processing for Human Resources: A Surveycited by 10
8 more
  1. 2022A challenge-based survey of e-recruitment recommendation systemscited by 9
  2. 2025ConFit v2: Improving Resume-Job Matching using Hypothetical Resume Embedding and Runner-Up Hard-Negative Miningcited by 5
  3. 2026UNIKIE-BENCH: Benchmarking Large Multimodal Models for Key Information Extraction in Visual Documentscited by 5
  4. 2024Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contaminationcited by 3
  5. 2026CC-OCR V2: Fine-Grained Attribution of LMM Failures in Real-World Visual Document Understandingcited by 3
  6. 2026PJB: A Reasoning-Aware Benchmark for Person-Job Retrievalcited by 2
  7. 2026WorkRB: A Community-Driven Evaluation Framework for AI in the Work Domaincited by 2
  8. 2026Chinese-SkillSpan: A Span-Level Dataset for ESCO-Aligned Competency Extraction from Chinese Job Adscited by 1

Built on by

Not cited yet.