mlsanityData to 14 Oct 2026

MazzikaAI: A knowledge-based performance-to-prompt compiler for real-time Arabic maqam accompaniment with a streaming text-to-music model

arXiv 2608.10360 ↗First posted 11 Aug 2026cs.HC cs.AI eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

Arabic maqam music microtonal, modal, and built on ornamented call and response is among the traditions most underserved by generative music models, whose training frameworks remain predominantly Western and equaltempered. Real time accompaniment sharpens this gap: an AI partner must listen, adapt dynamically, and respect idiomatic microtonal structures. Streaming text to music models provide strong generative capabilities but lack precise control interfaces. We present MazzikaAI, a knowledge based system that uses natural language as the actuator of a realtime control loop. By compiling live MIDI, gesture, and inferred harmony into continuously updated text prompts, MazzikaAI steers an unmodified streaming generator, Google Lyria RealTime, without requiring model finetuning. The system embeds expert knowledge of six core maqamat, characteristic ornaments, and ensemble dynamics, maintaining realtime responsiveness with subsecond keytoaudibleupdate latency. Empirical evaluations demonstrate that dynamic prompt compilation reliably grounds generation in microtonal scales, significantly increasing offgrid quartertone content over baseline generation. Beyond its core implementation, MazzikaAI illustrates how deterministic knowledgebased rules can effectively bridge expert, nonWestern musical traditions and unfinetuned foundation models. This architecture establishes a scalable paradigm for realtime humanAI cocreation, offering a generalizable blueprint for interactive accompaniment, adaptive music education, and culturally inclusive generative audio across diverse global idioms.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 25 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

11 of 25 references.

References · 11

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  3. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  4. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  5. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 583
  6. 2020Jukebox: A Generative Model for Musiccited by 542
  7. 2018Music Transformercited by 211
  8. 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 181
  9. 2018A Hierarchical Latent Vector Model for Learning Long-Term Structure in Musiccited by 131
  10. 2016DeepBach: a Steerable Model for Bach Chorales Generationcited by 91
  11. 2025ReaLJam: Real-Time Human-AI Music Jamming with Reinforcement Learning-Tuned Transformerscited by 7

Built on by

Not cited yet.