# Problems and Prospects for Intimate Musical Control of Computers

arXiv: https://arxiv.org/abs/2010.01570 · HTML: https://mlsanity.com/paper/2010.01570/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Oct 2020.

## Built on by (most cited first, 4 of 4)

- [Real-time Percussive Technique Recognition and Embedding Learning for the Acoustic Guitar](https://mlsanity.com/paper/2307.07426/) (2023)
- [Designing Neural Synthesizers for Low-Latency Interaction](https://mlsanity.com/paper/2503.11562/) (2025)
- [Combining Vision and EMG-Based Hand Tracking for Extended Reality Musical Instruments](https://mlsanity.com/paper/2307.10203/) (2023)
- [Exploring System Adaptations For Minimum Latency Real-Time Piano Transcription](https://mlsanity.com/paper/2509.07586/) (2025)

## Abstract (arXiv)

In this paper we describe our efforts towards the development of live performance computer-based musical instrumentation. Our design criteria include initial ease of use coupled with a long term potential for virtuosity, minimal and low variance latency, and clear and simple strategies for programming the relationship between gesture and musical result. We present custom controllers and unique adaptations of standard gestural interfaces, a programmable connectivity processor, a communications protocol called Open Sound Control (OSC), and a variety of metaphors for musical control. We further describe applications of our technology to a variety of real musical performances and directions for future research.