mlsanityData to 14 Oct 2026

WebCPM: Interactive Web Search for Chinese Long-form Question Answering

arXiv 2305.06849 ↗First posted 11 May 2023cs.CL cs.AI cs.IRcited by 93

Not on the map. Why?

Cited by 33 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Long-form question answering (LFQA) aims at answering complex, open-ended questions with detailed, paragraph-length responses. The de facto paradigm of LFQA necessitates two procedures: information retrieval, which searches for relevant supporting facts, and information synthesis, which integrates these facts into a coherent answer. In this paper, we introduce WebCPM, the first Chinese LFQA dataset. One unique feature of WebCPM is that its information retrieval is based on interactive web search, which engages with a search engine in real time. Following WebGPT, we develop a web search interface. We recruit annotators to search for relevant information using our interface and then answer questions. Meanwhile, the web search behaviors of our annotators would be recorded. In total, we collect 5,500 high-quality question-answer pairs, together with 14,315 supporting facts and 121,330 web search actions. We fine-tune pre-trained language models to imitate human behaviors for web search and to generate answers based on the collected facts. Our LFQA pipeline, built on these fine-tuned models, generates answers that are no worse than human-written ones in 32.5% and 47.5% of the cases on our dataset and DuReader, respectively.

Key facts. Cited by 93 papers in the map (data through 14 Oct 2026). Builds on 25 of its 38 references that are in the map. First posted on arXiv 11 May 2023.

Builds on

25 of 38 references.

References · 25

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2020Scaling Laws for Neural Language Modelscited by 6,586
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2020Learning to summarize from human feedbackcited by 2,588
  6. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  7. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  8. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  9. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  10. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  11. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  12. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
13 more
  1. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
  2. 2019ELI5: Long Form Question Answeringcited by 575
  3. 2019Neural Text Generation with Unlikelihood Trainingcited by 503
  4. 2022Teaching language models to support answers with verified quotescited by 292
  5. 2021Hurdles to Progress in Long-form Question Answeringcited by 167
  6. 2017DuReader: a Chinese Machine Reading Comprehension Dataset from Real-world Applicationscited by 110
  7. 2018A Span-Extraction Dataset for Chinese Machine Reading Comprehensioncited by 84
  8. 2019Investigating Prior Knowledge for Challenging Chinese Machine Reading Comprehensioncited by 81
  9. 2021CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generationcited by 81
  10. 2020CPM: A Large-scale Generative Chinese Pre-trained Language Modelcited by 60
  11. 2021Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinesecited by 45
  12. 2022How Do We Answer Complex Questions: Discourse Structure of Long-form Answerscited by 19
  13. 2022Modeling Exemplification in Long-form Question Answering via Retrievalcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 17; 2024: 44; 2025: 23; 2026: 9.

93 papers.

Sort:

By area:

  1. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  2. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  3. 2023Large Language Models for Information Retrieval: A Surveycited by 331
  4. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
  5. 2024Tool Learning with Large Language Models: A Surveycited by 223
  6. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 206
  7. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
  8. 2024StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Modelscited by 132
  9. 2024GUICourse: From General Vision Language Models to Versatile GUI Agentscited by 114
  10. 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 102
  11. 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
  12. 2024Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistancecited by 87
38 more
  1. 2024GTA: A Benchmark for General Tool Agentscited by 77
  2. 2024AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoningcited by 72
  3. 2023A Survey of Large Language Models Attributioncited by 71
  4. 2023Confucius: Iterative Tool Learning from Introspection Feedback by Easy-to-Difficult Curriculumcited by 65
  5. 2024Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learningcited by 65
  6. 2024LLM With Tools: A Surveycited by 61
  7. 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflowscited by 57
  8. 2024Tool Learning in the Wild: Empowering Language Models as Automatic Tool Agentscited by 56
  9. 2023TPTU: Large Language Model-based AI Agents for Task Planning and Tool Usagecited by 55
  10. 2024Instruction-tuned Language Models are Better Knowledge Learnerscited by 55
  11. 2024Learning to Use Tools via Cooperative and Interactive Agentscited by 54
  12. 2024FinTextQA: A Dataset for Long-form Financial Question Answeringcited by 54
  13. 2023LLatrieval: LLM-Verified Retrieval for Verifiable Generationcited by 52
  14. 2024Generate-then-Ground in Retrieval-Augmented Generation for Multi-hop Question Answeringcited by 51
  15. 2024From Exploration to Mastery: Enabling LLMs to Master Tools via Self-Driven Interactionscited by 46
  16. 2024Retrieve, Summarize, Plan: Advancing Multi-hop Question Answering with an Iterative Approachcited by 40
  17. 2024Reducing Tool Hallucination via Reliability Alignmentcited by 39
  18. 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 36
  19. 2025KaLM-Embedding-V2: Superior Training Techniques and Data Inspire A Versatile Embedding Modelcited by 36
  20. 2024VideoCoT: A Video Chain-of-Thought Dataset with Active Annotation Toolcited by 35
  21. 2024Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMscited by 34
  22. 2023How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advancescited by 33
  23. 2023Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional Trainingcited by 32
  24. 2024CaLMQA: Exploring culturally specific long-form question answering across 23 languagescited by 31
  25. 2024WorkflowLLM: Enhancing Workflow Orchestration Capability of Large Language Modelscited by 30
  26. 2023Information Retrieval Meets Large Language Models: A Strategic Report from Chinese IR Communitycited by 29
  27. 2024A Survey of Useful LLM Evaluationcited by 29
  28. 2025Learning to Generate Structured Output with Schema Reinforcement Learningcited by 29
  29. 2023D-Bot: Database Diagnosis System using Large Language Modelscited by 28
  30. 2023ProAgent: From Robotic Process Automation to Agentic Process Automationcited by 26
  31. 2024Boosting Conversational Question Answering with Fine-Grained Retrieval-Augmentation and Self-Checkcited by 24
  32. 2024Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmarkcited by 22
  33. 2023Towards Verifiable Text Generation with Evolving Memory and Self-Reflectioncited by 21
  34. 2024INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuningcited by 20
  35. 2025PlotGen: Multi-Agent LLM-based Scientific Data Visualization via Multimodal Feedbackcited by 20
  36. 2025MoC: Mixtures of Text Chunking Learners for Retrieval-Augmented Generation Systemcited by 19
  37. 2025Towards AI Search Paradigmcited by 19
  38. 2024FoRAG: Factuality-optimized Retrieval Augmented Generation for Web-enhanced Long-form Question Answeringcited by 18

50 most cited of 93 All 93 (JSON)