mlsanityData to 7 Oct 2026

Detecting Soft Skills in ML Engineering Roles CVs

arXiv 2608.10046 ↗First posted 10 Aug 2026cs.LG cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Soft skills shape collaboration among ML engineers, data scientists, and software engineers building ML-enabled systems, yet what we know about them comes almost entirely from the demand side. Job advertisements, surveys, and hiring manager interviews capture what employers ask for. How candidates themselves articulate these competencies has not been studied, and existing CV-mining work is both keyword-based, so it cannot see skills conveyed through narrative, and descriptive, reporting frequency rankings without testing whether group differences exceed sampling variation. We close both gaps. Using a balanced corpus of 300 curated CVs spanning the three roles, we extract explicitly listed and implicitly narrated soft skills with an LLM-based pipeline validated against a human-annotated ground truth, a distinction that existing extractors were not designed to make. We then convert the demand-side literature's claims into 13 falsifiable hypotheses about role signatures, seniority progression, and disclosure style, and test them with effect sizes under family-wise error control, so that candidate-side data can corroborate or contradict the demand-side account rather than merely illustrate it. Eleven hypotheses are supported, one partially, and one refuted. Candidates disclose soft skills through narrative rather than keyword lists by roughly three to one, and most so for the competencies employers value most: leadership, coordination, and mentoring (88-96% narrative). Seniority nearly triples the odds of articulating leadership. That competency, assumed universal in prior work, is articulated by software engineers at half the rate of their peers. Technical candidates do articulate soft skills, but a keyword-based screening systematically misses them.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 52 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

14 of 52 references.

References · 14

  1. 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
  2. 2025Can LLMs Replace Human Evaluators? An Empirical Study of LLM-as-a-Judge in Software Engineeringcited by 64
  3. 2021Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Processcited by 56
  4. 2022SkillSpan: Hard and Soft Skill Extraction from English Job Postingscited by 41
  5. 2024Can LLMs Replace Manual Annotation of Software Engineering Artifacts?cited by 40
  6. 2021How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Studycited by 29
  7. 2025Guidelines for Empirical Studies in Software Engineering involving Large Language Modelscited by 18
  8. 2023Extreme Multi-Label Skill Extraction Training using Large Language Modelscited by 17
  9. 2024Language Writ Large: LLMs, ChatGPT, Grounding, Meaning and Understandingcited by 12
  10. 2018Responsible team players wanted: an analysis of soft skill requirements in job advertisementscited by 3
  11. 2024Towards Effective Collaboration between Software Engineers and Data Scientists developing Machine Learning-Enabled Systemscited by 3
  12. 2025Prompt Engineer: Analyzing Hard and Soft Skill Requirements in the AI Job Marketcited by 3
2 more
  1. 2026Socio-Technical Anti-Patterns in Building ML-Enabled Software: Insights from Leaders on the Forefrontcited by 3
  2. 2025Curious, Critical Thinker, Empathetic, and Ethically Responsible: Essential Soft Skills for Data Scientists in Software Engineeringcited by 1

Built on by

Not cited yet.