mlsanityData to 14 Oct 2026

On the Resilience of Text-to-Video Diffusion Models to Hardware Faults

arXiv 2608.29598 ↗First posted 30 Aug 2026cs.LGcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

We present the first systematic study of the resilience of text-to-video (T2V) diffusion models under random hardware-level faults. While T2V models are widely used for automated video generation due to their ability to produce high-quality, temporally coherent, and realistic videos, their iterative denoising process and spatiotemporal dependencies introduce unique failure modes. We perform an extensive fault-injection study covering both computational and memory faults across three T2V models and a representative benchmark. Our results show that (1) a single fault can degrade overall performance by up to 3.7%, with semantic correctness more affected than perceptual quality; (2) memory faults are more damaging than computational faults, high-order exponent bits are particularly vulnerable, and the widely-used bfloat16 is more susceptible than alternative formats; and (3) 7-28% of faults cause visible artifacts, including semantic changes such as added objects, suggesting that single faults are sufficient to alter output semantics. Our findings reveal reliability risks in deployed T2V systems and motivate further research on improving fault resilience. Code: hrefhttps://github.com/ztcoalson/T2V-Resiliencehttps://github.com/ztcoalson/T2V-Resilience.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 26 of its 50 references that are in the map. First posted on arXiv 30 Aug 2026.

Builds on

26 of 50 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025LeMiCa: Lexicographic Minimax Path Caching for Efficient Diffusion-Based Video Generation30 Oct
  2. 2025Foresight: Adaptive Layer Reuse for Accelerated and High-Quality Text-to-Video Generation31 May
  3. 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
  4. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul

Other references · 22

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  7. 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 265
  8. 2019A Study of BFLOAT16 for Deep Learning Trainingcited by 232
  9. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
  10. 2019Bit-Flip Attack: Crushing Neural Network with Progressive Bit Searchcited by 108
  11. 2023Animate-A-Story: Storytelling with Retrieval-Augmented Video Generationcited by 90
  12. 2023Restart Sampling for Improving Generative Processescited by 84
10 more
  1. 2019Terminal Brain Damage: Exposing the Graceless Degradation in Deep Neural Networks Under Hardware Fault Attackscited by 57
  2. 2023MovieFactory: Automatic Movie Creation from Text using Large Generative Models for Language and Imagescited by 42
  3. 2025GPUHammer: Rowhammer Attacks on GPU Memories are Practicalcited by 11
  4. 2024DH-FaceVid-1K: A Large-Scale High-Quality Dataset for Face Video Generationcited by 9
  5. 2025ETVA: Evaluation of Text-to-Video Alignment via Fine-grained Question Generation and Answeringcited by 9
  6. 2024PrisonBreak: Jailbreaking Large Language Models with at Most Twenty-Five Targeted Bit-flipscited by 5
  7. 2022Characterizing a Neutron-Induced Fault Model for Deep Neural Networkscited by 3
  8. 2024Global Clipper: Enhancing Safety and Reliability of Transformer-based Object Detection Modelscited by 1
  9. 2025Breaking the HBM Bit Cost Barrier: Domain-Specific ECC for AI Inference Infrastructurecited by 1
  10. 2025Understanding the Landscape of Ampere GPU Memory Errorscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Early Failure Detection and Intervention in Video Diffusion Models
  2. 2025Error Analyses of Auto-Regressive Video Diffusion Models: A Unified Framework
  3. 2026Image-to-Video Diffusion: From Foundations to Open Frontiers
  4. 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedback
  5. 2026Efficient Video Diffusion Models: Advancements and Challenges
  6. 2025Corruption-Aware Training of Latent Video Diffusion Models for Robust Text-to-Video Generation
  7. 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recycling
  8. 2025Video Text Preservation with Synthetic Text-Rich Videos