# Investigating Direct Manipulation of Graphical Encodings as a Method for User Interaction

arXiv: https://arxiv.org/abs/1908.00679 · HTML: https://mlsanity.com/paper/1908.00679/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Aug 2019.

## Built on by (most cited first, 2 of 2)

- [Eliciting Model Steering Interactions from Users via Data and Visual Design Probes](https://mlsanity.com/paper/2310.09314/) (2023)
- [Signals of AI Hallucination: Designing Hallucination-Aware Cues for Embodied Conversational Agents in VR](https://mlsanity.com/paper/2609.28812/) (2026)

## Abstract (arXiv)

We investigate direct manipulation of graphical encodings as a method for interacting with visualizations. There is an increasing interest in developing visualization tools that enable users to perform operations by directly manipulating graphical encodings rather than external widgets such as checkboxes and sliders. Designers of such tools must decide which direct manipulation operations should be supported, and identify how each operation can be invoked. However, we lack empirical guidelines for how people convey their intended operations using direct manipulation of graphical encodings. We address this issue by conducting a qualitative study that examines how participants perform 15 operations using direct manipulation of standard graphical encodings. From this study, we 1) identify a list of strategies people employ to perform each operation, 2) observe commonalities in strategies across operations, and 3) derive implications to help designers leverage direct manipulation of graphical encoding as a method for user interaction.