mlsanityData to 14 Oct 2026

From Verification Burden to Trusted Collaboration: Design Goals for LLM-Assisted Literature Reviews

arXiv 2512.11661 ↗First posted 12 Dec 2025cs.HC cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are increasingly embedded in academic writing practices. Although numerous studies have explored how researchers employ these tools for scientific writing, their concrete implementation, limitations, and design challenges within the literature review process remain underexplored. In this paper, we report a user study with researchers across multiple disciplines to characterize current practices, benefits, and textitpain points in using LLMs to investigate related work. We identified three recurring gaps: (i) lack of trust in outputs, (ii) persistent verification burden, and (iii) requiring multiple tools. This motivates our proposal of six design goals and a high-level framework that operationalizes them through improved related papers visualization, verification at every step, and human-feedback alignment with generation-guided explanations. Overall, by grounding our work in the practical, day-to-day needs of researchers, we designed a framework that addresses these limitations and models real-world LLM-assisted writing, advancing trust through verifiable actions and fostering practical collaboration between researchers and AI systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 49 references that are in the map. First posted on arXiv 12 Dec 2025.

Builds on

19 of 49 references.

References · 19

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  5. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  6. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  7. 2023Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agentscited by 360
  8. 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 309
  9. 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
  10. 2023RankZephyr: Effective and Robust Zero-Shot Listwise Reranking is a Breeze!cited by 155
  11. 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 118
  12. 2024LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptionscited by 47
7 more
  1. 2024Towards Scientific Discovery with Generative AI: Progress, Opportunities, and Challengescited by 41
  2. 2022Self-Prompting Large Language Models for Zero-Shot Open-Domain QAcited by 39
  3. 2023Agent Instructs Large Language Models to be General Zero-Shot Reasonerscited by 32
  4. 2024Artificial Intelligence for Literature Reviews: Opportunities and Challengescited by 30
  5. 2024ChatCite: LLM Agent with Human Workflow Guidance for Comparative Literature Summarycited by 30
  6. 2022Target-aware Abstractive Related Work Generation with Contrastive Learningcited by 20
  7. 2024The Howard-Harvard effect: Institutional reproduction of intersectional inequalitiescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.