ISPA: Inter-Species Phonetic Alphabet for Transcribing Animal Sounds
Not on the map. Why?
Abstract (arXiv)
Traditionally, bioacoustics has relied on spectrograms and continuous, per-frame audio representations for the analysis of animal sounds, also serving as input to machine learning models. Meanwhile, the International Phonetic Alphabet (IPA) system has provided an interpretable, language-independent method for transcribing human speech sounds. In this paper, we introduce ISPA (Inter-Species Phonetic Alphabet), a precise, concise, and interpretable system designed for transcribing animal sounds into text. We compare acoustics-based and feature-based methods for transcribing and classifying animal sounds, demonstrating their comparable performance with baseline methods utilizing continuous, dense audio representations. By representing animal sounds with text, we effectively treat them as a "foreign language," and we show that established human language ML paradigms and models, such as language models, can be successfully applied to improve performance.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 16 of its 28 references that are in the map. First posted on arXiv 5 Feb 2024.
Builds on
16 of 28 references.
References · 16
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2017Neural Discrete Representation Learningcited by 4,712
- 2023A Survey of Large Language Modelscited by 2,576
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 717
- 2021AST: Audio Spectrogram Transformercited by 643
- 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 342
- 2020Universal Phone Recognition with a Multilingual Allophone Systemcited by 81
- 2021Computational bioacoustics with deep learning: a review and roadmapcited by 78
- 2022AVES: Animal Vocalization Encoder based on Self-Supervisioncited by 53
- 2022BEANS: The Benchmark of Animal Soundscited by 38
4 more
- 2017An embedded segmental K-means model for unsupervised segmentation and clustering of speechcited by 31
- 2021Variable-rate discrete representation learningcited by 24
- 2023PESTO: Pitch Estimation with Self-supervised Transposition-equivariant Objectivecited by 18
- 2021HumBugDB: A Large-scale Acoustic Mosquito Datasetcited by 15
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 1.
4 papers.
- 2025PESTO: Real-Time Pitch Estimation with Self-supervised Transposition-equivariant Objectivecited by 3
- 2024UniGlyph: A Seven-Segment Script for Universal Language Representationcited by 0
- 2025On Non-interactive Evaluation of Animal Communication Translatorscited by 0
- 2026BAGEL: Benchmarking Animal Knowledge Expertise in Language Modelscited by 0
- 2026BAGEL: Benchmarking Animal Knowledge Expertise in Language Models17 Apr 2026
- 2025On Non-interactive Evaluation of Animal Communication Translators17 Oct 2025
- 2025PESTO: Real-Time Pitch Estimation with Self-supervised Transposition-equivariant Objective2 Aug 2025
- 2024UniGlyph: A Seven-Segment Script for Universal Language Representation11 Oct 2024