mlsanityData to 14 Oct 2026

Amphion: An Open-Source Audio, Music and Speech Generation Toolkit

arXiv 2312.09911 ↗First posted 15 Dec 2023cs.SD eess.AScited by 27

Not on the map. Why?

Abstract (arXiv)

Amphion is an open-source toolkit for Audio, Music, and Speech Generation, targeting to ease the way for junior researchers and engineers into these fields. It presents a unified framework that includes diverse generation tasks and models, with the added bonus of being easily extendable for new incorporation. The toolkit is designed with beginner-friendly workflows and pre-trained models, allowing both beginners and seasoned researchers to kick-start their projects with relative ease. The initial release of Amphion v0.1 supports a range of tasks including Text to Speech (TTS), Text to Audio (TTA), and Singing Voice Conversion (SVC), supplemented by essential components like data preprocessing, state-of-the-art vocoders, and evaluation metrics. This paper presents a high-level overview of Amphion. Amphion is open-sourced at https://github.com/open-mmlab/Amphion.

Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Dec 2023.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 8; 2025: 16; 2026: 3.

27 papers.

Sort:

By area:

  1. 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 204
  2. 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 161
  3. 2024SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Wordscited by 68
  4. 2025ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matchingcited by 30
  5. 2024Both Ears Wide Open: Towards Language-Driven Spatial Audio Generationcited by 25
  6. 2025Emilia: A Large-Scale, Extensive, Multilingual, and Diverse Dataset for Speech Generationcited by 20
  7. 2025SpeechJudge: Towards Human-Level Judgment for Speech Naturalnesscited by 15
  8. 2025ESPnet-SpeechLM: An Open Speech Language Model Toolkitcited by 9
  9. 2025TTSDS2: Resources and Benchmark for Evaluating Human-Quality Text to Speech Systemscited by 8
  10. 2025Multi-Metric Preference Alignment for Generative Speech Restorationcited by 7
  11. 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generationcited by 5
  12. 2025OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matchingcited by 4
15 more
  1. 2025Pairwise Evaluation of Accent Similarity in Speech Synthesiscited by 4
  2. 2024SingVisio: Visual Analytics of Diffusion Model for Singing Voice Conversioncited by 2
  3. 2025AnyAccomp: Generalizable Accompaniment Generation via Quantized Melodic Bottleneckcited by 2
  4. 2025Speech Language Models for Under-Represented Languages: Insights from Wolofcited by 2
  5. 2025HQ-SVC: Towards High-Quality Zero-Shot Singing Voice Conversion in Low-Resource Scenarioscited by 2
  6. 2024SpMis: An Investigation of Synthetic Spoken Misinformation Detectioncited by 1
  7. 2024Noro: Noise-Robust One-shot Voice Conversion with Hidden Speaker Representation Learningcited by 1
  8. 2025MaskVCT: Masked Voice Codec Transformer for Zero-Shot Voice Conversion With Increased Controllability via Multiple Guidancescited by 1
  9. 2024ConSinger: Efficient High-Fidelity Singing Voice Generation with Minimal Stepscited by 0
  10. 2025DiFlow-TTS: Compact and Low-Latency Zero-Shot Text-to-Speech with Discrete Flow Matchingcited by 0
  11. 2025Flamed-TTS: Flow Matching Attention-Free Models for Efficient Generating and Dynamic Pacing Zero-shot Text-to-Speechcited by 0
  12. 2025TokenChain: A Discrete Speech Chain via Semantic Token Modelingcited by 0
  13. 2026SPARCLE: SPeaker-aware Aligned Representations via Contrastive Language Embeddingscited by 0
  14. 2026AI-Based Sound Effect Generation: A Narrative Review of Generative Models Across Input Modalitiescited by 0
  15. 2026Can LLM Agents Automate Reinforcement Learning for Text-to-Speech?cited by 0