AI Coach Assist: An Automated Approach for Call Recommendation in Contact Centers for Agent Coaching
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
In recent years, the utilization of Artificial Intelligence (AI) in the contact center industry is on the rise. One area where AI can have a significant impact is in the coaching of contact center agents. By analyzing call transcripts using Natural Language Processing (NLP) techniques, it would be possible to quickly determine which calls are most relevant for coaching purposes. In this paper, we present AI Coach Assist, which leverages the pre-trained transformer-based language models to determine whether a given call is coachable or not based on the quality assurance (QA) questions asked by the contact center managers or supervisors. The system was trained and evaluated on a large dataset collected from real-world contact centers and provides an effective way to recommend calls to the contact center managers that are more likely to contain coachable moments. Our experimental findings demonstrate the potential of AI Coach Assist to improve the coaching process, resulting in enhancing the performance of contact center agents.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 14 of its 23 references that are in the map. First posted on arXiv 28 May 2023.
Builds on
14 of 23 references.
References · 14
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2023PaLM 2 Technical Reportcited by 1,154
- 2021DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarizationcited by 72
- 2021Domain Adaptation with Pre-trained Transformers for Query Focused Abstractive Text Summarizationcited by 21
- 2022BLINK with Elasticsearch for Efficient Entity Linking in Business Conversationscited by 13
- 2022An Effective, Performant Named Entity Recognition System for Noisy Business Telephone Conversation Transcriptscited by 7
- 2022Improving Named Entity Recognition in Telephone Conversations via Effective Active Learning with Human in the Loopcited by 7
Built on by
Citing papers per year: 2023: 2; 2024: 0; 2025: 2; 2026: 4.
8 papers.
- 2023Building Real-World Meeting Summarization Systems using Large Language Models: A Practical Perspectivecited by 34
- 2023Are Large Language Models Reliable Judges? A Study on the Factuality Evaluation Capabilities of LLMscited by 23
- 2025AI Knowledge Assist: An Automated Approach for the Creation of Knowledge Bases for Conversational AI Agentscited by 4
- 2026From Text to Voice: A Reproducible and Verifiable Framework for Evaluating Tool Calling LLM Agentscited by 4
- 2026Counterfactual Fairness Evaluation of LLM-Based Contact Center Agent Quality Assurance Systemcited by 2
- 2025Why Synthetic Isn't Real Yet: A Diagnostic Framework for Contact Center Dialogue Generationcited by 1
- 2026Beyond Text-to-SQL: An Agentic LLM System for Governed Enterprise Analytics APIscited by 1
- 2026When Better Turns Do Not Make Better Agents: Diagnosing the Gap Between Next-Turn Metrics and Workflow Successcited by 1
- 2026When Better Turns Do Not Make Better Agents: Diagnosing the Gap Between Next-Turn Metrics and Workflow Success18 Sep 2026
- 2026Beyond Text-to-SQL: An Agentic LLM System for Governed Enterprise Analytics APIs20 May 2026
- 2026From Text to Voice: A Reproducible and Verifiable Framework for Evaluating Tool Calling LLM Agents14 May 2026
- 2026Counterfactual Fairness Evaluation of LLM-Based Contact Center Agent Quality Assurance System16 Feb 2026
- 2025AI Knowledge Assist: An Automated Approach for the Creation of Knowledge Bases for Conversational AI Agents9 Oct 2025
- 2025Why Synthetic Isn't Real Yet: A Diagnostic Framework for Contact Center Dialogue Generation25 Aug 2025
- 2023Are Large Language Models Reliable Judges? A Study on the Factuality Evaluation Capabilities of LLMs1 Nov 2023
- 2023Building Real-World Meeting Summarization Systems using Large Language Models: A Practical Perspective30 Oct 2023
Similar, not cited
Close in wording, no citation either way
- 2026From Transcripts to AI Agents: Knowledge Extraction, RAG Integration, and Robust Evaluation of Conversational AI Assistants
- 2025Redefining CX with Agentic AI: Minerva CQ Case Study
- 2026SETU: An Agentic Ecosystem for Multilingual, Persona-Aware Communication Coaching
- 2025Cloning a Conversational Voice AI Agent from Call,Recording Datasets for Telesales
- 2024Automated test generation to evaluate tool-augmented LLMs as conversational AI agents
- 2025Introducing Axlerod: An LLM-based Chatbot for Assisting Independent Insurance Agents
- 2025tAIfa: Enhancing Team Effectiveness and Cohesion with AI-Generated Automated Feedback
- 2024Assessing the Performance of Human-Capable LLMs -- Are LLMs Coming for Your Job?