mlsanityData to 7 Oct 2026

The First Place Solution of WSDM Cup 2024: Leveraging Large Language Models for Conversational Multi-Doc QA

arXiv 2402.18385 ↗First posted 28 Feb 2024cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Conversational multi-doc question answering aims to answer specific questions based on the retrieved documents as well as the contextual conversations. In this paper, we introduce our winning approach for the "Conversational Multi-Doc QA" challenge in WSDM Cup 2024, which exploits the superior natural language understanding and generation capability of Large Language Models (LLMs). We first adapt LLMs to the task, then devise a hybrid training strategy to make the most of in-domain unlabeled data. Moreover, an advanced text embedding model is adopted to filter out potentially irrelevant documents and several approaches are designed and compared for the model ensemble. Equipped with all these techniques, our solution finally ranked 1st place in WSDM Cup 2024, surpassing its rivals to a large extent. The source codes have been released at https://github.com/zhangzhao219/WSDM-Cup-2024.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 4 of its 14 references that are in the map. First posted on arXiv 28 Feb 2024.

Builds on

4 of 14 references.

References · 4

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  3. 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
  4. 2022Large Language Models with Controllable Working Memorycited by 169

Built on by

Cited by year

Citing papers per year: 2024: 2.

2 papers.

  1. 2024A Survey on Recent Advances in Conversational Data Generationcited by 23
  2. 2024Extending Token Computation for LLM Reasoningcited by 3