From SERPs to Agents: A Platform for Comparative Studies of Information Interaction
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
The diversification of information access systems, from RAG to autonomous agents, creates a critical need for comparative user studies. However, the technical overhead to deploy and manage these distinct systems is a major barrier. We present UXLab, an open-source system for web-based user studies that addresses this challenge. Its core is a web-based dashboard enabling the complete, no-code configuration of complex experimental designs. Researchers can visually manage the full study, from recruitment to comparing backends like traditional search, vector databases, and LLMs. We demonstrate UXLab's value via a micro case study comparing user behavior with RAG versus an autonomous agent. UXLab allows researchers to focus on experimental design and analysis, supporting future multi-modal interaction research.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 7 of its 16 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
7 of 16 references.
References · 7
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 123
- 2021Pyserini: An Easy-to-Use Python Toolkit to Support Replicable IR Research with Sparse and Dense Representationscited by 60
- 2019Macaw: An Extensible Conversational Information Seeking Platformcited by 8
- 2023The Information Retrieval Experiment Platformcited by 3
- 2025StudyAlign: A Software System for Conducting Web-Based User Studies with Functional Interactive Prototypescited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Mapping the Design Space of User Experience for Computer Use Agents
- 2025Understanding User Experiences of Computer Use Agents: Design Space and Opportunities for Building Agent UX Prototypes
- 2026UXSim: Towards a Hybrid User Search Simulation
- 2026Affora: A Design System for Agent-Friendly Interfaces
- 2026The Tool Illusion: Rethinking Tool Use in Web Agents
- 2025The Adoption and Usage of AI Agents: Early Evidence from Perplexity
- 2025AgentA/B: Automated and Scalable Web A/BTesting with Interactive LLM Agents
- 2026UXCascade: Scalable Usability Testing with Simulated User Agents