mlsanityData to 14 Oct 2026

Adaptive Fault Tolerance Mechanisms of Large Language Models in Cloud Computing Environments

arXiv 2503.12228 ↗First posted 15 Mar 2025cs.DC cs.AIcited by 12

Not on the map. Why?

Abstract (arXiv)

With the rapid evolution of Large Language Models (LLMs) and their large-scale experimentation in cloud-computing spaces, the challenge of guaranteeing their security and efficiency in a failure scenario has become a main issue. To ensure the reliability and availability of large-scale language models in cloud computing scenarios, such as frequent resource failures, network problems, and computational overheads, this study proposes a novel adaptive fault tolerance mechanism. It builds upon known fault-tolerant mechanisms, such as checkpointing, redundancy, and state transposition, introducing dynamic resource allocation and prediction of failure based on real-time performance metrics. The hybrid model integrates data driven deep learning-based anomaly detection technique underlining the contribution of cloud orchestration middleware for predictive prevention of system failures. Additionally, the model integrates adaptive checkpointing and recovery strategies that dynamically adapt according to load and system state to minimize the influence on the performance of the model and minimize downtime. The experimental results demonstrate that the designed model considerably enhances the fault tolerance in large-scale cloud surroundings, and decreases the system downtime by 30%, and has a better modeling availability than the classical fault tolerance mechanism.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 19 of its 37 references that are in the map. First posted on arXiv 15 Mar 2025.

Builds on

19 of 37 references.

References · 19

  1. 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 399
  2. 2024MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialoguescited by 250
  3. 2024MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUscited by 112
  4. 2023Deception Detection from Linguistic and Physiological Data Streams Using Bimodal Convolutional Neural Networkscited by 56
  5. 2024GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Modelscited by 43
  6. 2024ComposerX: Multi-Agent Symbolic Music Composition with LLMscited by 42
  7. 2025Language in the Flow of Time: Time-Series-Paired Texts Weaved into a Unified Temporal Narrativecited by 40
  8. 2024Heterogeneous Contrastive Learning for Foundation Models and Beyondcited by 27
  9. 2024Efficient Training of Large Language Models on Distributed Infrastructures: A Surveycited by 27
  10. 2024AD-LLM: Benchmarking Large Language Models for Anomaly Detectioncited by 26
  11. 2024Mitigating the Risk of Health Inequity Exacerbated by Large Language Modelscited by 21
  12. 2024Enhance Image-to-Image Generation with LLaVA-generated Promptscited by 20
7 more
  1. 2024NLP-ADBench: NLP Anomaly Detection Benchmarkcited by 17
  2. 2023T-GAE: Transferable Graph Autoencoder for Network Alignmentcited by 14
  3. 2024PyG-SSL: A Graph Self-Supervised Learning Toolkitcited by 14
  4. 2024Can Graph Neural Networks Learn Language with Extremely Weak Text Supervision?cited by 13
  5. 2024A Pre-trained Sequential Recommendation Framework: Popularity Dynamics for Zero-shot Transfercited by 12
  6. 2020Beyond Localized Graph Neural Networks: An Attributed Motif Regularization Frameworkcited by 10
  7. 2024Real-time Vehicle-to-Vehicle Communication Based Network Cooperative Control System through Distributed Database and Multimodal Perception: Demonstrated in Crossroadscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 2.

12 papers.