mlsanityData to 13 Oct 2026

Digits micro-model for accurate and secure transactions

arXiv 2402.01931 ↗First posted 2 Feb 2024cs.LG cs.CL cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

Automatic Speech Recognition (ASR) systems are used in the financial domain to enhance the caller experience by enabling natural language understanding and facilitating efficient and intuitive interactions. Increasing use of ASR systems requires that such systems exhibit very low error rates. The predominant ASR models to collect numeric data are large, general-purpose commercial models -- Google Speech-to-text (STT), or Amazon Transcribe -- or open source (OpenAI's Whisper). Such ASR models are trained on hundreds of thousands of hours of audio data and require considerable resources to run. Despite recent progress large speech recognition models, we highlight the potential of smaller, specialized "micro" models. Such light models can be trained perform well on number recognition specific tasks, competing with general models like Whisper or Google STT while using less than 80 minutes of training time and occupying at least an order of less memory resources. Also, unlike larger speech recognition models, micro-models are trained on carefully selected and curated datasets, which makes them highly accurate, agile, and easy to retrain, while using low compute resources. We present our work on creating micro models for multi-digit number recognition that handle diverse speaking styles reflecting real-world pronunciation patterns. Our work contributes to domain-specific ASR models, improving digit recognition accuracy, and privacy of data. An added advantage, their low resource consumption allows them to be hosted on-premise, keeping private data local instead uploading to an external cloud. Our results indicate that our micro-model makes less errors than the best-of-breed commercial or open-source ASRs in recognizing digits (1.8% error rate of our best micro-model versus 5.8% error rate of Whisper), and has a low memory footprint (0.66 GB VRAM for our model versus 11 GB VRAM for Whisper).

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 9 of its 14 references that are in the map. First posted on arXiv 2 Feb 2024.

Builds on

9 of 14 references.

References · 9

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,004
  2. 2019Speech Model Pre-training for End-to-End Spoken Language Understandingcited by 192
  3. 2018Spoken Language Understanding on the Edgecited by 27
  4. 2021Timers and Such: A Practical Benchmark for Spoken Language Understanding with Numberscited by 11
  5. 2020Deep Neural Networks for Automatic Speech Processing: A Survey from Large Corpora to Limited Datacited by 9
  6. 2021Remember the context! ASR slot error correction through memorizationcited by 9
  7. 2021Learning Domain Specific Language Models for Automatic Speech Recognition through Machine Translationcited by 2
  8. 2023Political corpus creation through automatic speech recognition on EU debatescited by 1
  9. 2023Fingerprint Attack: Client De-Anonymization in Federated Learningcited by 1

Built on by

Not cited yet.