Model Fusion with Multi-LoRA Inference for Tool-Enhanced Game Dialogue Agents
Not on the map. Why?
Abstract (arXiv)
This paper presents the opdainlp team's solution for the GPU track of the CPDC 2025 challenge. The challenge consists of three tasks, aiming to build an in-game conversational AI that adheres to character personas, aligns with the game's worldview, and supports function calling. Considering both effectiveness and resource/time constraints during inference, we synthesized data for some of the tasks based on the datasets provided by the competition organizers. We employed Qwen3-14B with LoRA fine-tuning and model fusion, and utilized a base model integrated with multiple LoRA adapters during inference. Specifically, in the competition, we used three distinct LoRA adapters to handle tool calling, response generation with tool call results, and response generation without tool call results, respectively. MultiLoRA inference was implemented using vLLM. Our solution achieved the first place in Task 1 and Task 3, and the second place in Task 2 of the GPU track.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 7 of its 9 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
7 of 9 references.
References · 7
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2023SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scalingcited by 172
- 2024xLAM: A Family of Large Action Models to Empower AI Agent Systemscited by 111
- 2023PeaCoK: Persona Commonsense Knowledge for Consistent and Engaging Narrativescited by 19
- 2024ComperDial: Commonsense Persona-grounded Dialogue Dataset and Benchmarkcited by 3
- 2024Winning Amazon KDD Cup'24cited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025GVGAI-LLM: Evaluating Large Language Model Agents with Infinite Games
- 2024LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report
- 2024LLMArena: Assessing Capabilities of Large Language Models in Dynamic Multi-Agent Environments
- 2026GameTalk: Training LLMs for Strategic Conversation
- 2024Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent
- 2025Efficient Tool-Calling Multi-Expert NPC Agent for Commonsense Persona-Grounded Dialogue
- 2025Serving Heterogeneous LoRA Adapters in Distributed LLM Inference Systems
- 2026ToolRACER: A Robust Agentic Conversation Emulation Resource for Agent Training and Evaluation