mlsanityData to 7 Oct 2026

InfiniteAudio: Infinite-Length Audio Generation with Consistency

arXiv 2506.03020 ↗First posted 3 Jun 2025eess.AScited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

This paper presents InfiniteAudio, a simple yet effective strategy for generating infinite-length audio using diffusion-based text-to-audio methods. Current approaches face memory constraints because the output size increases with input length, making long duration generation challenging. A common workaround is to concatenate short audio segments, but this often leads to inconsistencies due to the lack of shared temporal context. To address this, InfiniteAudio integrates seamlessly into existing pipelines without additional training. It introduces two key techniques: FIFO sampling, a first-in, first-out inference strategy with fixed-size inputs, and curved denoising, which selectively prioritizes key diffusion steps for efficiency. Experiments show that InfiniteAudio achieves comparable or superior performance across all metrics. Audio samples are available on our project page.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 37 of its 38 references that are in the map. First posted on arXiv 3 Jun 2025.

Builds on

37 of 38 references.

Closest ancestors · 16

Same direction, newest first

  1. 2024VoiceDiT: Dual-Condition Diffusion Transformer for Environment-Aware Speech Synthesis26 Dec
  2. 2024FlowAVSE: Efficient Audio-Visual Speech Enhancement with Conditional Flow Matching13 Jun
  3. 2024AudioLCM: Text-to-Audio Generation with Latent Consistency Models1 Jun
  4. 2023Audiobox: Unified Audio Generation with Natural Language Prompts25 Dec
  5. 2023Seeing Through the Conversation: Audio-Visual Speech Separation based on Diffusion Model30 Oct
  6. 2023Audio Generation with Multiple Conditional Diffusion Model23 Aug
  7. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining10 Aug
  8. 2023StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models13 Jun
  9. 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model24 Apr
  10. 2023DiffVoice: Text-to-Speech with Latent Diffusion23 Apr
  11. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models30 Jan
  12. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Models29 Jan
4 more
  1. 2022Diffsound: Discrete Diffusion Model for Text-to-sound Generation20 Jul
  2. 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidance23 Nov
  3. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech13 May
  4. 2021Diff-TTS: A Denoising Diffusion Model for Text-to-Speech3 Apr

Other references · 21

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  9. 2022Video Diffusion Modelscited by 2,280
  10. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  11. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  12. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
9 more
  1. 2023ModelScope Text-to-Video Technical Reportcited by 651
  2. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  3. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  4. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  5. 2022AudioGen: Textually Guided Audio Generationcited by 292
  6. 2022Diffusion Probabilistic Modeling for Video Generationcited by 237
  7. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
  8. 2023Retrieval-Augmented Text-to-Audio Generationcited by 23
  9. 2023VoiceLDM: Text-to-Speech with Environmental Contextcited by 23

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024FlashAudio: Rectified Flows for Fast and High-Fidelity Text-to-Audio Generation
  2. 2025AudioTurbo: Fast Text-to-Audio Generation with Rectified Diffusion
  3. 2025DreamAudio: Customized Text-to-Audio Generation with Diffusion Models
  4. 2026AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation
  5. 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation
  6. 2023ArchiSound: Audio Generation with Diffusion
  7. 2023ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency Distillation
  8. 2024LiteFocus: Accelerated Diffusion Inference for Long Audio Synthesis