mlsanityData to 14 Oct 2026

Simulating Articulatory Trajectories with Phonological Feature Interpolation

arXiv 2408.04363 ↗First posted 8 Aug 2024eess.AS cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

As a first step towards a complete computational model of speech learning involving perception-production loops, we investigate the forward mapping between pseudo-motor commands and articulatory trajectories. Two phonological feature sets, based respectively on generative and articulatory phonology, are used to encode a phonetic target sequence. Different interpolation techniques are compared to generate smooth trajectories in these feature spaces, with a potential optimisation of the target value and timing to capture co-articulation effects. We report the Pearson correlation between a linear projection of the generated trajectories and articulatory data derived from a multi-speaker dataset of electromagnetic articulography (EMA) recordings. A correlation of 0.67 is obtained with an extended feature set based on generative phonology and a linear interpolation technique. We discuss the implications of our results for our understanding of the dynamics of biological motion.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 23 references that are in the map. First posted on arXiv 8 Aug 2024.

Builds on

7 of 23 references.

References · 7

  1. 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 666
  2. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 616
  3. 2021Generative Spoken Language Modeling from Raw Audiocited by 340
  4. 2022Self-supervised language learning from raw audio: Lessons from the Zero Resource Speech Challengecited by 34
  5. 2022Evidence of Vocal Tract Articulation in Self-Supervised Learning of Speechcited by 31
  6. 2022Evaluating context-invariance in unsupervised speech representationscited by 11
  7. 2022Repeat after me: Self-supervised learning of acoustic-to-articulatory mapping by vocal imitationcited by 3

Built on by

Not cited yet.