mlsanityData to 14 Oct 2026

Anatomy-aware cross-speaker adaptation of complete vocal-tract acoustic-to-articulatory inversion

arXiv 2609.29766 ↗First posted 24 Sep 2026eess.AS cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Cross-speaker acoustic-to-articulatory inversion requires accounting for anatomical differences between speakers. We propose a geometric adaptation framework that uses anatomical landmarks, primarily on vertebrae and dental structures,to transfer predictions from a fixed inversion model to unseen speakers. An affine transformation followed by thin-plate spline (TPS) deformation maps the predicted contours of 10 vocal-tract structures into each target speaker's geometry without retraining. Landmarks are identified in one selected /u/ frame per speaker as a common phonetic reference without assuming identical articulatory configurations across speakers, and the resulting mapping is reused across recordings. We train the model on a single-speaker rt-MRI database and evaluate adaptation on eight speakers from a separate multi-speaker rt-MRI database. We compare affine and TPS configurations using 12 or 14 landmarks. Affine12+TPS14 achieves the lowest mean point-to-closest-point error of 3.19mm. These results support the combined value of anatomical landmark information and nonrigid alignment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 19 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

5 of 19 references.

References · 5

  1. 2023Self-Supervised Models of Speech Infer Universal Articulatory Kinematicscited by 16
  2. 2023Speaker-Independent Acoustic-to-Articulatory Speech Inversioncited by 15
  3. 2025Reconstruction of the Complete Vocal Tract Contour Through Acoustic to Articulatory Inversion Using Real-Time MRI Datacited by 3
  4. 2020Speaker dependent acoustic-to-articulatory inversion using real-time MRI of the vocal tractcited by 2
  5. 2026Acoustic-to-articulatory Inversion of the Complete Vocal Tract from RT-MRI with Various Audio Embeddings and Dataset Sizescited by 1

Built on by

Not cited yet.