Orca: Browsing at Scale Through User-Driven and AI-Facilitated Orchestration Across Malleable Webpages
Not on the map. Why?
Abstract (arXiv)
Web-based activities span multiple webpages. However, conventional browsers with stacks of tabs cannot support operating and synthesizing large volumes of information across pages. While recent AI systems enable fully automated web browsing and information synthesis, they often diminish user agency and hinder contextual understanding. We explore how AI could instead augment user interactions with content across webpages and mitigate cognitive and manual efforts. Through literature on information tasks and web browsing challenges, and an iterative design process, we present novel interactions with our prototype web browser, Orca. Leveraging AI, Orca supports user-driven exploration, operation, organization, and synthesis of web content at scale. To enable browsing at scale, webpages are treated as malleable materials that humans and AI can collaboratively manipulate and compose into a malleable, dynamic, and browser-level workspace. Our evaluation revealed an increased "appetite" for information foraging, enhanced control, and more flexible sensemaking across a broader web information landscape.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 19 of its 115 references that are in the map. First posted on arXiv 28 May 2025.
Builds on
19 of 115 references.
References · 19
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
- 2023Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfacescited by 72
- 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagramscited by 66
- 2023Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Modelscited by 48
- 2025CowPilot: A Framework for Autonomous and Human-Agent Collaborative Web Navigationcited by 36
- 2024Improving Steering and Verification in AI-Assisted Data Analysis with Interactive Task Decompositioncited by 29
- 2025Generative and Malleable User Interfaces with Generative and Evolving Task-Driven Data Modelcited by 26
- 2024Search Engines in an AI Era: The False Promise of Factual and Verifiable Source-Cited Responsescited by 15
- 2024Textoshop: Interactions Inspired by Drawing Software to Facilitate Text Editingcited by 12
- 2022Crystalline: Lowering the Cost for Developers to Collect and Organize Information for Decision Makingcited by 7
7 more
- 2025Malleable Overview-Detail Interfacescited by 7
- 2022Fuse: In-Situ Sensemaking Support in the Browsercited by 6
- 2023CrossTalk: Intelligent Substrates for Language-Oriented Interaction in Video-Based Communication and Collaborationcited by 6
- 2022Wigglite: Low-cost Information Collection and Triagecited by 5
- 2023DiLogics: Creating Web Automation Programs With Diverse Logicscited by 5
- 2025Feedforward in Generative AI: Opportunities for a Design Spacecited by 5
- 2013DOBBS: Towards a Comprehensive Dataset to Study the Browsing Behavior of Online Userscited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025Interaction-Driven Browsing: A Human-in-the-Loop Conceptual Framework Informed by Human Web Browsing for Browser-Using Agentscited by 3
- 2025On the Regulatory Potential of User Interfaces for AI Agent Governancecited by 3
- 2026"When to Hand Off, When to Work Together": Understanding Concurrent Human-Agent Interaction in Shared Co-Creative Workspacescited by 1
- 2026Sidekick: Designing Communication for Effective Multitasking with Computer Use Agentscited by 0
- 2026Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Executioncited by 0
- 2026Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Execution14 Oct 2026
- 2026Sidekick: Designing Communication for Effective Multitasking with Computer Use Agents20 Jul 2026
- 2026"When to Hand Off, When to Work Together": Understanding Concurrent Human-Agent Interaction in Shared Co-Creative Workspaces2 Mar 2026
- 2025On the Regulatory Potential of User Interfaces for AI Agent Governance30 Nov 2025
- 2025Interaction-Driven Browsing: A Human-in-the-Loop Conceptual Framework Informed by Human Web Browsing for Browser-Using Agents15 Sep 2025