mlsanityData to 7 Oct 2026

ScalablePromptus: Scalable and High-Fidelity Prompt-Based Video Streaming

arXiv 2607.26106 ↗First posted 28 Jul 2026eess.IV cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Prompt-based video streaming transmits compact semantic prompts instead of pixel-level content for generative reconstruction, enabling ultra-low-bitrate communication. However, the state-of-the-art Promptus framework is vulnerable to network fluctuation, where partially received prompts lead to catastrophic quality collapse. We propose ScalablePromptus, which enhances Promptus with semantic and color-aware prompt inversion, spherical linear interpolation for intermediate frames, and--most critically--a dropout training strategy that produces rank-ordered prompt representations. This allows the receiver to reconstruct meaningful video from arbitrarily truncated prompts without any adaptation. Under stable networks, ScalablePromptus achieves modest quality gains. Under lossy conditions, it reduces the performance degradation caused by truncation by 82%-95% compared to the baseline, making prompt-based streaming robust enough for real-world deployment.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 25 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

12 of 25 references.

References · 12

  1. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  2. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  3. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  4. 2023Neural Video Compression with Diverse Contextscited by 155
  5. 2024Neural Video Compression with Feature Modulationcited by 115
  6. 2019Video Compression With Rate-Distortion Autoencoderscited by 97
  7. 2014Learning Ordered Representations with Nested Dropoutcited by 81
  8. 2022CaDM: Codec-aware Diffusion Modeling for Neural-enhanced Video Streamingcited by 23
  9. 2024Mitigate the Gap: Investigating Approaches for Improving Cross-Modal Alignment in CLIPcited by 23
  10. 2023Reparo: Loss-Resilient Generative Codec for Video Conferencingcited by 8
  11. 2022Boosting neural video codecs by exploiting hierarchical redundancycited by 5
  12. 2025Addressing degeneracies in latent interpolation for diffusion modelscited by 1

Built on by

Not cited yet.