mlsanityData to 7 Oct 2026

AuraLuxMuse: Adaptive Fusion Modeling for Aesthetic Stage Lighting Design with Music and Expert Guidance

arXiv 2610.11792 ↗First posted 8 Oct 2026cs.MM cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We present AuraLuxMuse, a novel system for automated aesthetic stage lighting design that integrates expert knowledge, representation learning, and preference-adaptive modeling. Lighting design in live performance settings requires the seamless translation of musical features into dynamic lighting behaviors. However, traditional workflows remain time-consuming, labor-intensive, and difficult to transfer. AuraLuxMuse encodes music and professional cue sequences into a shared retrieval space, estimates cue-event density, and retargets selected fixture commands to the destination stage. It assists pre-production authoring by returning editable cues rather than replacing the designer with an unconstrained generator. At the heart of AuraLuxMuse are two key modules: Lighting-Aligned Music Pretraining (LAMP), which performs contrastive learning between audio and lighting cues for alignment, and Preference-Adaptive Mixture of Experts (PAMoE), which conditions preference-aware cue retrieval and adaptation on designers' intent through a gated ensemble of style-specific expert networks. To support training and evaluation, we introduce Musilux, the first dataset of paired musical audio and professional lighting cue sequences under diverse performance scenarios. We evaluate AuraLuxMuse across both virtual simulation environments and professional-grade laboratories. Experimental results, including objective and subjective evaluation, demonstrate that AuraLuxMuse retrieves and adapts stage-lighting cues that are visually cohesive, semantically meaningful, and artistically expressive, showing its potential for AI-assisted aesthetic stage design.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 53 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

29 of 53 references.

References · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  8. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  9. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  10. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  11. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
  12. 2016CNN Architectures for Large-Scale Audio Classificationcited by 701
17 more
  1. 2021AST: Audio Spectrogram Transformercited by 634
  2. 2021AudioCLIP: Extending CLIP to Image, Text and Audiocited by 335
  3. 2017GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibriumcited by 208
  4. 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 177
  5. 2017Learning to Predict Indoor Illumination from a Single Imagecited by 160
  6. 2021Contrastive Learning of Musical Representationscited by 81
  7. 2022Contrastive Audio-Language Learning for Musiccited by 32
  8. 2025WavRAG: Audio-Integrated Retrieval Augmented Generation for Spoken Dialogue Modelscited by 18
  9. 2018MEGAN: Mixture of Experts of Generative Adversarial Networks for Multimodal Image Generationcited by 15
  10. 2021SpecTNT: a Time-Frequency Transformer for Music Audiocited by 15
  11. 2023CLaMP: Contrastive Language-Music Pre-training for Cross-Modal Symbolic Music Information Retrievalcited by 14
  12. 2024Style Mixture of Experts for Expressive Text-To-Speech Synthesiscited by 6
  13. 2024Audiobox TTA-RAG: Improving Zero-Shot and Few-Shot Text-To-Audio with Retrieval-Augmented Generationcited by 6
  14. 2025SLAP: Siamese Language-Audio Pretraining Without Negative Samples for Music Understandingcited by 4
  15. 2024Unveiling Visual Biases in Audio-Visual Localization Benchmarkscited by 3
  16. 2025ComplexDec: A Domain-robust High-fidelity Neural Audio Codec with Complex Spectrum Modelingcited by 3
  17. 2019Speech Enhancement via Deep Spectrum Image Translation Networkcited by 1

Built on by

Not cited yet.