mlsanityData to 14 Oct 2026

MobileVidFactory: Automatic Diffusion-Based Social Media Video Generation for Mobile Devices from Text

arXiv 2307.16371 ↗First posted 31 Jul 2023cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Videos for mobile devices become the most popular access to share and acquire information recently. For the convenience of users' creation, in this paper, we present a system, namely MobileVidFactory, to automatically generate vertical mobile videos where users only need to give simple texts mainly. Our system consists of two parts: basic and customized generation. In the basic generation, we take advantage of the pretrained image diffusion model, and adapt it to a high-quality open-domain vertical video generator for mobile devices. As for the audio, by retrieving from our big database, our system matches a suitable background sound for the video. Additionally to produce customized content, our system allows users to add specified screen texts to the video for enriching visual expression, and specify texts for automatic reading with optional voices as they like.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 15 of its 17 references that are in the map. First posted on arXiv 31 Jul 2023.

Builds on

15 of 17 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  5. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  6. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  7. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
  8. 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 227
  9. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
  10. 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 154
  11. 2021Audio Retrieval with Natural Language Queries: A Benchmark Studycited by 61
  12. 2021Audio Retrieval with Natural Language Queriescited by 49
3 more
  1. 2023MovieFactory: Automatic Movie Creation from Text using Large Generative Models for Language and Imagescited by 42
  2. 2023Sounding Video Generator: A Unified Framework for Text-guided Sounding Video Generationcited by 15
  3. 2022TTVFI: Learning Trajectory-Aware Transformer for Video Frame Interpolationcited by 14

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 2; 2025: 1.

4 papers.

  1. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  2. 2024Zero-Reference Low-Light Enhancement via Physical Quadruple Priorscited by 58
  3. 2023Flow-Guided Diffusion for Video Inpaintingcited by 11
  4. 2025FastCar: Cache Attentive Replay for Fast Auto-Regressive Video Generation on the Edgecited by 10

Similar, not cited

Close in wording, no citation either way

  1. 2023MEVG: Multi-event Video Generation with Text-to-Video Models
  2. 2024SnapGen-V: Generating a Five-Second Video within Five Seconds on a Mobile Device
  3. 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Models
  4. 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devices
  5. 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devices
  6. 2025Taming Diffusion Transformer for Efficient Mobile Video Generation in Seconds
  7. 2024Mobile Video Diffusion
  8. 2024I4VGen: Image as Free Stepping Stone for Text-to-Video Generation