mlsanityData to 14 Oct 2026

From Toil to Thought: Designing for Strategic Exploration and Responsible AI in Systematic Literature Reviews

arXiv 2603.05514 ↗First posted 21 Jan 2026cs.HC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Systematic Literature Reviews (SLRs) are fundamental to scientific progress, yet the process is hindered by a fragmented tool ecosystem that imposes a high cognitive load. This friction suppresses the iterative, exploratory nature of scholarly work. To investigate these challenges, we conducted an exploratory design study with 20 experienced researchers. This study identified key friction points: 1) the high cognitive load of managing iterative query refinement across multiple databases, 2) the overwhelming scale and pace of publication of modern literature, and 3) the tension between automation and scholarly agency. Informed by these findings, we developed ARC, a design probe that operationalizes solutions for multi-database integration, transparent iterative search, and verifiable AI-assisted screening. A comparative user study with 8 researchers suggests that an integrated environment facilitates a transition in scholarly work, moving researchers from managing administrative overhead to engaging in strategic exploration. By utilizing external representations to scaffold strategic exploration and transparent AI reasoning, our system supports verifiable judgment, aiming to augment expert contributions from initial creation through long-term maintenance of knowledge synthesis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 89 references that are in the map. First posted on arXiv 21 Jan 2026.

Builds on

16 of 89 references.

References · 16

  1. 2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthycited by 183
  2. 2023The Robots are Here: Navigating the Generative AI Revolution in Computing Educationcited by 86
  3. 2025Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and Inconsistenciescited by 39
  4. 2020Open Source Software for Efficient and Transparent Reviewscited by 35
  5. 2022Scim: Intelligent Skimming Support for Scientific Paperscited by 27
  6. 2023Synergi: A Mixed-Initiative System for Scholarly Synthesis and Sensemakingcited by 26
  7. 2022Threddy: An Interactive System for Personalized Thread-based Exploration and Organization of Scientific Literaturecited by 22
  8. 2023CiteSee: Augmenting Citations in Scientific Papers with Persistent and Personalized Historical Contextcited by 22
  9. 2023Relatedly: Scaffolding Literature Reviews with Existing Related Work Sectionscited by 21
  10. 2024PaperWeaver: Enriching Topical Paper Alerts by Contextualizing Recommended Papers with User-collected Paperscited by 18
  11. 2023Successful Combination of Database Search and Snowballing for Identification of Primary Studies in Systematic Literature Studiescited by 16
  12. 2020Large-scale comparison of bibliographic data sources: Scopus, Web of Science, Dimensions, Crossref, and Microsoft Academiccited by 11
4 more
  1. 2023ComLittee: Literature Discovery with Personal Elected Author Committeescited by 10
  2. 2025ScholarMate: A Mixed-Initiative Tool for Qualitative Knowledge Work and Information Sensemakingcited by 7
  3. 2025Toward Living Narrative Reviews: An Empirical Study of the Processes and Challenges in Updating Survey Articles in Computing Researchcited by 2
  4. 2021Paperfetcher: A tool to automate handsearch for systematic reviewscited by 1

Built on by

Not cited yet.