mlsanityData to 14 Oct 2026

Evaluating LLMs for Career Guidance: Comparative Analysis of Computing Competency Recommendations Across Ten African Countries

arXiv 2510.18902 ↗First posted 20 Oct 2025cs.CY cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Employers increasingly expect graduates to utilize large language models (LLMs) in the workplace, yet the competencies needed for computing roles across Africa remain unclear given varying national contexts. This study examined how six LLMs, namely ChatGPT 4, DeepSeek, Gemini, Claude 3.5, Llama 3, and Mistral AI, describe entry-level computing career expectations across ten African countries. Using the Computing Curricula 2020 framework and drawing on Digital Colonialism Theory and Ubuntu Philosophy, content analysis of 60 LLM responses to standardized prompts reveals consistent coverage of technical competencies such as cloud computing and programming, but notable differences in non-technical competencies, particularly ethics and responsible AI use. Models vary considerably in recognizing country-specific factors, including local technology ecosystems, language requirements, and national policies averaging only 35.4% contextual awareness overall. Open-source models demonstrated stronger contextual awareness and better balance between technical and professional skills, with Llama (4.47/5) and DeepSeek (4.25/5) outperforming proprietary alternatives ChatGPT-4 (3.90/5) and Claude (3.46/5). However, Mistral's poor contextual performance (0.00/4) despite being open-source indicates that development philosophy alone does not guarantee contextual responsiveness. This first comprehensive comparison of LLM career guidance for African computing students uncovers entrenched infrastructure assumptions and Western-centric biases that create gaps between technical recommendations and local realities. The findings challenge assumptions about AI tool quality in resource-constrained settings and underscore the need for decolonial approaches to AI in education, emphasizing contextual relevance and hybrid human-AI guidance models.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 91 references that are in the map. First posted on arXiv 20 Oct 2025.

Builds on

12 of 91 references.

References · 12

  1. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  2. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  3. 2023Gender bias and stereotypes in Large Language Modelscited by 187
  4. 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 101
  5. 2023The Robots are Here: Navigating the Generative AI Revolution in Computing Educationcited by 86
  6. 2024Beware of Metacognitive Laziness: Effects of Generative Artificial Intelligence on Learning Motivation, Processes, and Performancecited by 58
  7. 2023AfroBench: How Good are Large Language Models on African Languages?cited by 43
  8. 2024InkubaLM: A small language model for low-resource African languagescited by 18
  9. 2023Generative Job Recommendations with Large Language Modelcited by 13
  10. 2024ResumeFlow: An LLM-facilitated Pipeline for Personalized Resume Generation and Refinementcited by 6
  11. 2025Designing Conversational AI to Support Think-Aloud Practice in Technical Interview Preparation for CS Studentscited by 2
  12. 2023Artificial Intelligence in Career Counseling: A Test Case with ResumAIcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.