mlsanityData to 7 Oct 2026

Credit C-GPT: A Domain-Specialized Large Language Model for Conversational Understanding in Vietnamese Debt Collection

arXiv 2601.10167 ↗First posted 15 Jan 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Debt collection is a critical function within the banking, financial services, and insurance (BFSI) sector, relying heavily on large-scale human-to-human conversational interactions conducted primarily in Vietnamese contact centers. These conversations involve informal spoken language, emotional variability, and complex domain-specific reasoning, which pose significant challenges for traditional natural language processing systems. This paper introduces Credit C-GPT, a domain-specialized large language model with seven billion parameters, fine-tuned for conversational understanding in Vietnamese debt collection scenarios. The proposed model integrates multiple conversational intelligence tasks, including dialogue understanding, sentiment recognition, intent detection, call stage classification, and structured slot-value extraction, within a single reasoning-based framework. We describe the data construction process, annotation strategy, and training methodology, and evaluate the model on proprietary human-annotated datasets. Experimental results show consistent improvements over traditional pipeline-based approaches, indicating that domain-specialized conversational language models provide a scalable and privacy-aware solution for real-time assistance and post-call analytics in enterprise contact centers.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 28 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

14 of 28 references.

References · 14

  1. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  2. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  3. 2023BloombergGPT: A Large Language Model for Financecited by 923
  4. 2022Galactica: A Large Language Model for Sciencecited by 736
  5. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
  6. 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 378
  7. 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
  8. 2020FinBERT: A Pretrained Language Model for Financial Communicationscited by 161
  9. 2020PhoBERT: Pre-trained language models for Vietnamesecited by 148
  10. 2023Do We Still Need Clinical Language Models?cited by 97
  11. 2024BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Textcited by 85
  12. 2021Revisiting the Boundary between ASR and NLU in the Age of Conversational Dialog Systemscited by 15
2 more
  1. 2025Advances in LLMs with Focus on Reasoning, Adaptability, Efficiency and Ethicscited by 2
  2. 2024Transforming NLU with Babylon: A Case Study in Development of Real-time, Edge-Efficient, Multi-Intent Translation System for Automated Drive-Thru Orderingcited by 1

Built on by

Not cited yet.