mlsanityData to 7 Oct 2026

XR-CareerAssist: An Immersive Platform for Personalised Career Guidance Leveraging Extended Reality and Multimodal AI

arXiv 2604.06901 ↗First posted 8 Apr 2026cs.CE cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Conventional career guidance platforms rely on static, text-driven interfaces that struggle to engage users or deliver personalised, evidence-based insights. Although Computer-Assisted Career Guidance Systems have evolved since the 1960s, they remain limited in interactivity and pay little attention to the narrative dimensions of career development. We introduce XR-CareerAssist, a platform that unifies Extended Reality (XR) with several Artificial Intelligence (AI) modules to deliver immersive, multilingual career guidance. The system integrates Automatic Speech Recognition for voice-driven interaction, Neural Machine Translation across English, Greek, French, and Italian, a Langchain-based conversational Training Assistant for personalised dialogue, a BLIP-based Vision-Language model for career visualisations, and AWS Polly Text-to-Speech delivered through an interactive 3D avatar. Career trajectories are rendered as dynamic Sankey diagrams derived from a repository of more than 100,000 anonymised professional profiles. The application was built in Unity for Meta Quest 3, with backend services hosted on AWS. A pilot evaluation at the University of Exeter with 23 participants returned 95.6% speech recognition accuracy, 78.3% overall user satisfaction, and 91.3% favourable ratings for system responsiveness, with feedback informing subsequent improvements to motion comfort, audio clarity, and text legibility. XR-CareerAssist demonstrates how the fusion of XR and AI can produce more engaging, accessible, and effective career development tools, with the integration of five AI modules within a single immersive environment yielding a multimodal interaction experience that distinguishes it from existing career guidance platforms.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 24 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

8 of 24 references.

References · 8

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  5. 2020Beyond English-Centric Multilingual Machine Translationcited by 559
  6. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
  7. 2021A Survey on Neural Speech Synthesiscited by 182
  8. 2022A Survey of Vision-Language Pre-Trained Modelscited by 177

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Letters from Future Self: Augmenting the Letter-Exchange Exercise with LLM-based Agents to Enhance Young Adults' Career Exploration
  2. 2025SimInterview: Transforming Business Education through Large Language Model-Based Simulated Multilingual Interview Training System
  3. 2025JobSphere: An AI-Powered Multilingual Career Copilot for Government Employment Platforms
  4. 2024Conversate: Supporting Reflective Learning in Interview Practice Through Interactive Simulation and Dialogic Feedback
  5. 2026When Generative AI Meets Extended Reality: Enabling Scalable and Natural Interactions
  6. 2024CUIfy the XR: An Open-Source Package to Embed LLM-powered Conversational Agents in XR
  7. 2026JobHop v2: A Large-Scale Career Trajectory Dataset from Unstructured Resumes
  8. 2024PRISM: A Personalized, Rapid, and Immersive Skill Mastery framework for personalizing experiential learning through Generative AI