# Scribosermo: Fast Speech-to-Text models for German and other Languages

arXiv: https://arxiv.org/abs/2110.07982 · HTML: https://mlsanity.com/paper/2110.07982/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- Builds on 9 of its 51 references that are in the map.
- First posted on arXiv 15 Oct 2021.

## Builds on (most cited first, 9 of 9)

- [SGDR: Stochastic Gradient Descent with Warm Restarts](https://mlsanity.com/paper/1608.03983/) (2016)
- [Common Voice: A Massively-Multilingual Speech Corpus](https://mlsanity.com/paper/1912.06670/) (2019)
- [VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretation](https://mlsanity.com/paper/2101.00390/) (2021)
- [Streaming End-to-end Speech Recognition For Mobile Devices](https://mlsanity.com/paper/1811.06621/) (2018)
- [The Multilingual TEDx Corpus for Speech Recognition and Translation](https://mlsanity.com/paper/2102.01757/) (2021)
- [QuartzNet: Deep Automatic Speech Recognition with 1D Time-Channel Separable Convolutions](https://mlsanity.com/paper/1910.10261/) (2019)
- [CSS10: A Collection of Single Speaker Speech Datasets for 10 Languages](https://mlsanity.com/paper/1903.11269/) (2019)
- [Tiny Transducer: A Highly-efficient Speech Recognition Model on Edge Devices](https://mlsanity.com/paper/2101.06856/) (2021)
- [IMS-Speech: A Speech to Text Tool](https://mlsanity.com/paper/1908.04743/) (2019)

## Built on by (most cited first, 7 of 7)

- [VoxelKeypointFusion: Generalizable Multi-View Multi-Person Pose Estimation](https://mlsanity.com/paper/2410.18723/) (2024)
- [Finstreder: Simple and fast Spoken Language Understanding with Finite State Transducers using modern Speech-to-Text models](https://mlsanity.com/paper/2206.14589/) (2022)
- [ASR in German: A Detailed Error Analysis](https://mlsanity.com/paper/2204.05617/) (2022)
- [ASR Bundestag: A Large-Scale political debate dataset in German](https://mlsanity.com/paper/2302.06008/) (2023)
- [TEVR: Improving Speech Recognition by Token Entropy Variance Reduction](https://mlsanity.com/paper/2206.12693/) (2022)
- [Jaco: An Offline Running Privacy-aware Voice Assistant](https://mlsanity.com/paper/2209.07775/) (2022)
- [Scriboora: Rethinking Human Pose Forecasting](https://mlsanity.com/paper/2511.15565/) (2025)

## Abstract (arXiv)

Recent Speech-to-Text models often require a large amount of hardware resources and are mostly trained in English. This paper presents Speech-to-Text models for German, as well as for Spanish and French with special features: (a) They are small and run in real-time on microcontrollers like a RaspberryPi. (b) Using a pretrained English model, they can be trained on consumer-grade hardware with a relatively small dataset. (c) The models are competitive with other solutions and outperform them in German. In this respect, the models combine advantages of other approaches, which only include a subset of the presented features. Furthermore, the paper provides a new library for handling datasets, which is focused on easy extension with additional datasets and shows an optimized way for transfer-learning new languages using a pretrained model from another language with a similar alphabet.
