Credit C-GPT: A Domain-Specialized Large Language Model for Conversational Understanding in Vietnamese Debt Collection
Not on the map. Why?
Abstract (arXiv)
Debt collection is a critical function within the banking, financial services, and insurance (BFSI) sector, relying heavily on large-scale human-to-human conversational interactions conducted primarily in Vietnamese contact centers. These conversations involve informal spoken language, emotional variability, and complex domain-specific reasoning, which pose significant challenges for traditional natural language processing systems. This paper introduces Credit C-GPT, a domain-specialized large language model with seven billion parameters, fine-tuned for conversational understanding in Vietnamese debt collection scenarios. The proposed model integrates multiple conversational intelligence tasks, including dialogue understanding, sentiment recognition, intent detection, call stage classification, and structured slot-value extraction, within a single reasoning-based framework. We describe the data construction process, annotation strategy, and training methodology, and evaluate the model on proprietary human-annotated datasets. Experimental results show consistent improvements over traditional pipeline-based approaches, indicating that domain-specialized conversational language models provide a scalable and privacy-aware solution for real-time assistance and post-call analytics in enterprise contact centers.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 28 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
14 of 28 references.
References · 14
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
- 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 378
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2020FinBERT: A Pretrained Language Model for Financial Communicationscited by 161
- 2020PhoBERT: Pre-trained language models for Vietnamesecited by 148
- 2023Do We Still Need Clinical Language Models?cited by 97
- 2024BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Textcited by 85
- 2021Revisiting the Boundary between ASR and NLU in the Age of Conversational Dialog Systemscited by 15
Built on by
Not cited yet.