# A Mapping Strategy for Interacting with Latent Audio Synthesis Using Artistic Materials

arXiv: https://arxiv.org/abs/2407.04379 · HTML: https://mlsanity.com/paper/2407.04379/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Jul 2024.

## Built on by (most cited first, 2 of 2)

- [XAIxArts Manifesto: Explainable AI for the Arts](https://mlsanity.com/paper/2502.21220/) (2025)
- [Latent Fourier Transform](https://mlsanity.com/paper/2604.17986/) (2026)

## Abstract (arXiv)

This paper presents a mapping strategy for interacting with the latent spaces of generative AI models. Our approach involves using unsupervised feature learning to encode a human control space and mapping it to an audio synthesis model's latent space. To demonstrate how this mapping strategy can turn high-dimensional sensor data into control mechanisms of a deep generative model, we present a proof-of-concept system that uses visual sketches to control an audio synthesis model. We draw on emerging discourses in XAIxArts to discuss how this approach can contribute to XAI in artistic and creative contexts, we also discuss its current limitations and propose future research directions.