mlsanityData to 7 Oct 2026

Understanding Usage and Engagement in AI-Powered Scientific Research Tools: The Asta Interaction Dataset

arXiv 2602.23335 ↗First posted 26 Feb 2026cs.HC cs.AI cs.IRcited by 2

Not on the map. Why?

Abstract (arXiv)

AI-powered scientific research tools are rapidly being integrated into research workflows, yet the field lacks a clear lens into how researchers use these systems in real-world settings. We present and analyze the Asta Interaction Dataset, a large-scale resource comprising over 200,000 user queries and interaction logs from two deployed tools (a literature discovery interface and a scientific question-answering interface) within an LLM-powered retrieval-augmented generation platform. Using this dataset, we characterize query patterns, engagement behaviors, and how usage evolves with experience. We find that users submit longer and more complex queries than in traditional search, and treat the system as a collaborative research partner, delegating tasks such as drafting content and identifying research gaps. Users treat generated responses as persistent artifacts, revisiting and navigating among outputs and cited evidence in non-linear ways. With experience, users issue more targeted queries and engage more deeply with supporting citations, although keyword-style queries persist even among experienced users. We release the anonymized dataset and analysis with a new query intent taxonomy to inform future designs of real-world AI research assistants and to support realistic evaluation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 11 of its 42 references that are in the map. First posted on arXiv 26 Feb 2026.

Builds on

11 of 42 references.

References · 11

  1. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
  2. 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 121
  3. 2025Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversationscited by 88
  4. 2024Understanding User Experience in Large Language Model Interactionscited by 43
  5. 2025Investigating Affective Use and Emotional Well-being on ChatGPTcited by 36
  6. 2023Using Large Language Models to Generate, Validate, and Apply User Intent Taxonomiescited by 34
  7. 2025Anthropic Economic Index report: Uneven geographic and enterprise AI adoptioncited by 23
  8. 2026State of AI: An Empirical 100 Trillion Token Study with OpenRoutercited by 15
  9. 2025The Adoption and Usage of AI Agents: Early Evidence from Perplexitycited by 12
  10. 2024Using LLMs to Investigate Correlations of Conversational Follow-up Queries with User Satisfactioncited by 6
  11. 2025Trapped by Expectations: Functional Fixedness in LLM-Enabled Chat Searchcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AISSISTANT: Human-AI Collaborative Review and Perspective Research Workflows in Data Science
  2. 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation
  3. 2025A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applications
  4. 2025Chatting with Papers: A Hybrid Approach Using LLMs and Knowledge Graphs
  5. 2025The Budget AI Researcher and the Power of RAG Chains
  6. 2026AquiLLM: An Architecture for Supporting Tacit Knowledge Capture in Research Groups
  7. 2025ResearchGPT: Benchmarking and Training LLMs for End-to-End Computer Science Research Workflows
  8. 2024ResearchArena: Benchmarking Large Language Models' Ability to Collect and Organize Information as Research Agents