mlsanityData to 7 Oct 2026

QbyE-MLPMixer: Query-by-Example Open-Vocabulary Keyword Spotting using MLPMixer

arXiv 2206.13231 ↗First posted 23 Jun 2022eess.AS cs.CL cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Current keyword spotting systems are typically trained with a large amount of pre-defined keywords. Recognizing keywords in an open-vocabulary setting is essential for personalizing smart device interaction. Towards this goal, we propose a pure MLP-based neural network that is based on MLPMixer - an MLP model architecture that effectively replaces the attention mechanism in Vision Transformers. We investigate different ways of adapting the MLPMixer architecture to the QbyE open-vocabulary keyword spotting task. Comparisons with the state-of-the-art RNN and CNN models show that our method achieves better performance in challenging situations (10dB and 6dB environments) on both the publicly available Hey-Snips dataset and a larger scale internal dataset with 400 speakers. Our proposed model also has a smaller number of parameters and MACs compared to the baseline models.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 20 of its 37 references that are in the map. First posted on arXiv 23 Jun 2022.

Builds on

20 of 37 references.

References · 20

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  3. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  4. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  5. 2019Searching for MobileNetV3cited by 1,984
  6. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  7. 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
  8. 2021Pay Attention to MLPscited by 367
  9. 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 338
  10. 2020Rethinking CNN Models for Audio Classificationcited by 48
  11. 2019A scalable noisy speech dataset and online subjective test frameworkcited by 47
  12. 2021RepMLP: Re-parameterizing Convolutions into Fully-connected Layers for Image Recognitioncited by 40
8 more
  1. 2016Discriminative Acoustic Word Embeddings: Recurrent Neural Network-Based Approachescited by 25
  2. 2021Query-by-Example Keyword Spotting system using Multi-head Attention and Softtriple Losscited by 25
  3. 2017Streaming Small-Footprint Keyword Spotting using Sequence-to-Sequence Modelscited by 19
  4. 2018DONUT: CTC-based Query-by-Example Keyword Spottingcited by 15
  5. 2021Wake Word Detection with Streaming Transformerscited by 10
  6. 2020Small-Footprint Open-Vocabulary Keyword Spotting with Quantized LSTM Networkscited by 9
  7. 2020Hybrid Transformer/CTC Networks for Hardware Efficient Voice Triggeringcited by 8
  8. 2020Howl: A Deployed, Open-Source Wake Word Detection Systemcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 1; 2025: 0; 2026: 1.

4 papers.

  1. 2023Few-Shot Open-Set Learning for On-Device Customization of KeyWord Spotting Systemscited by 9
  2. 2023Latent Phrase Matching for Dysarthric Speechcited by 2
  3. 2024Query-by-Example Keyword Spotting Using Spectral-Temporal Graph Attentive Pooling and Multi-Task Learningcited by 0
  4. 2026PromptKWS: A Novel Prompt-Guided Open-Vocabulary Keyword Spotting Frameworkcited by 0