mlsanityData to 14 Oct 2026

Orca: Browsing at Scale Through User-Driven and AI-Facilitated Orchestration Across Malleable Webpages

arXiv 2505.22831 ↗First posted 28 May 2025cs.HC cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Web-based activities span multiple webpages. However, conventional browsers with stacks of tabs cannot support operating and synthesizing large volumes of information across pages. While recent AI systems enable fully automated web browsing and information synthesis, they often diminish user agency and hinder contextual understanding. We explore how AI could instead augment user interactions with content across webpages and mitigate cognitive and manual efforts. Through literature on information tasks and web browsing challenges, and an iterative design process, we present novel interactions with our prototype web browser, Orca. Leveraging AI, Orca supports user-driven exploration, operation, organization, and synthesis of web content at scale. To enable browsing at scale, webpages are treated as malleable materials that humans and AI can collaboratively manipulate and compose into a malleable, dynamic, and browser-level workspace. Our evaluation revealed an increased "appetite" for information foraging, enhanced control, and more flexible sensemaking across a broader web information landscape.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 19 of its 115 references that are in the map. First posted on arXiv 28 May 2025.

Builds on

19 of 115 references.

References · 19

  1. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  2. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  3. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  4. 2023Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfacescited by 72
  5. 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagramscited by 66
  6. 2023Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Modelscited by 48
  7. 2025CowPilot: A Framework for Autonomous and Human-Agent Collaborative Web Navigationcited by 36
  8. 2024Improving Steering and Verification in AI-Assisted Data Analysis with Interactive Task Decompositioncited by 29
  9. 2025Generative and Malleable User Interfaces with Generative and Evolving Task-Driven Data Modelcited by 26
  10. 2024Search Engines in an AI Era: The False Promise of Factual and Verifiable Source-Cited Responsescited by 15
  11. 2024Textoshop: Interactions Inspired by Drawing Software to Facilitate Text Editingcited by 12
  12. 2022Crystalline: Lowering the Cost for Developers to Collect and Organize Information for Decision Makingcited by 7
7 more
  1. 2025Malleable Overview-Detail Interfacescited by 7
  2. 2022Fuse: In-Situ Sensemaking Support in the Browsercited by 6
  3. 2023CrossTalk: Intelligent Substrates for Language-Oriented Interaction in Video-Based Communication and Collaborationcited by 6
  4. 2022Wigglite: Low-cost Information Collection and Triagecited by 5
  5. 2023DiLogics: Creating Web Automation Programs With Diverse Logicscited by 5
  6. 2025Feedforward in Generative AI: Opportunities for a Design Spacecited by 5
  7. 2013DOBBS: Towards a Comprehensive Dataset to Study the Browsing Behavior of Online Userscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.