Adaptive Fault Tolerance Mechanisms of Large Language Models in Cloud Computing Environments
Not on the map. Why?
Abstract (arXiv)
With the rapid evolution of Large Language Models (LLMs) and their large-scale experimentation in cloud-computing spaces, the challenge of guaranteeing their security and efficiency in a failure scenario has become a main issue. To ensure the reliability and availability of large-scale language models in cloud computing scenarios, such as frequent resource failures, network problems, and computational overheads, this study proposes a novel adaptive fault tolerance mechanism. It builds upon known fault-tolerant mechanisms, such as checkpointing, redundancy, and state transposition, introducing dynamic resource allocation and prediction of failure based on real-time performance metrics. The hybrid model integrates data driven deep learning-based anomaly detection technique underlining the contribution of cloud orchestration middleware for predictive prevention of system failures. Additionally, the model integrates adaptive checkpointing and recovery strategies that dynamically adapt according to load and system state to minimize the influence on the performance of the model and minimize downtime. The experimental results demonstrate that the designed model considerably enhances the fault tolerance in large-scale cloud surroundings, and decreases the system downtime by 30%, and has a better modeling availability than the classical fault tolerance mechanism.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 19 of its 37 references that are in the map. First posted on arXiv 15 Mar 2025.
Builds on
19 of 37 references.
References · 19
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 399
- 2024MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialoguescited by 250
- 2024MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUscited by 112
- 2023Deception Detection from Linguistic and Physiological Data Streams Using Bimodal Convolutional Neural Networkscited by 56
- 2024GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Modelscited by 43
- 2024ComposerX: Multi-Agent Symbolic Music Composition with LLMscited by 42
- 2025Language in the Flow of Time: Time-Series-Paired Texts Weaved into a Unified Temporal Narrativecited by 40
- 2024Heterogeneous Contrastive Learning for Foundation Models and Beyondcited by 27
- 2024Efficient Training of Large Language Models on Distributed Infrastructures: A Surveycited by 27
- 2024AD-LLM: Benchmarking Large Language Models for Anomaly Detectioncited by 26
- 2024Mitigating the Risk of Health Inequity Exacerbated by Large Language Modelscited by 21
- 2024Enhance Image-to-Image Generation with LLaVA-generated Promptscited by 20
7 more
- 2024NLP-ADBench: NLP Anomaly Detection Benchmarkcited by 17
- 2023T-GAE: Transferable Graph Autoencoder for Network Alignmentcited by 14
- 2024PyG-SSL: A Graph Self-Supervised Learning Toolkitcited by 14
- 2024Can Graph Neural Networks Learn Language with Extremely Weak Text Supervision?cited by 13
- 2024A Pre-trained Sequential Recommendation Framework: Popularity Dynamics for Zero-shot Transfercited by 12
- 2020Beyond Localized Graph Neural Networks: An Attributed Motif Regularization Frameworkcited by 10
- 2024Real-time Vehicle-to-Vehicle Communication Based Network Cooperative Control System through Distributed Database and Multimodal Perception: Demonstrated in Crossroadscited by 6
Built on by
Citing papers per year: 2025: 10; 2026: 2.
12 papers.
- 2025From Mind to Machine: The Rise of Manus AI as a Fully Autonomous Digital Agentcited by 33
- 2025Cloud-Based AI Systems: Leveraging Large Language Models for Intelligent Fault Detection and Autonomous Self-Healingcited by 10
- 2025Data Augmentation Through Random Style Replacementcited by 9
- 2025Cross-Cloud Data Privacy Protection: Optimizing Collaborative Mechanisms of AI Systems by Integrating Federated Learning and LLMscited by 9
- 2025Instruction Tuning and CoT Prompting for Contextual Medical QA with LLMscited by 5
- 2025A Blueprint for AI-Driven Software Quality: Integrating LLMs with Established Standardscited by 1
- 2025Anomaly Detection and Early Warning Mechanism for Intelligent Monitoring Systems in Multi-Cloud Environments Based on LLMcited by 1
- 2025Federated Learning-Based Data Collaboration Method for Enhancing Edge Cloud AI System Security Using Large Language Modelscited by 1
- 2025An Intelligent Fault Self-Healing Mechanism for Cloud AI Systems via Integration of Large Language Models and Deep Reinforcement Learningcited by 0
- 2025Leveraging Large Language Model for Intelligent Log Processing and Autonomous Debugging in Cloud AI Platformscited by 0
- 2026Orbax: Distributed Checkpointing with JAXcited by 0
- 2026Safe and Adaptive Cloud Healing: Verifying LLM-Generated Recovery Plans with a Neural-Symbolic World Modelcited by 0
- 2026Safe and Adaptive Cloud Healing: Verifying LLM-Generated Recovery Plans with a Neural-Symbolic World Model2 Jul 2026
- 2026Orbax: Distributed Checkpointing with JAX21 May 2026
- 2025Federated Learning-Based Data Collaboration Method for Enhancing Edge Cloud AI System Security Using Large Language Models22 Jun 2025
- 2025Leveraging Large Language Model for Intelligent Log Processing and Autonomous Debugging in Cloud AI Platforms22 Jun 2025
- 2025Instruction Tuning and CoT Prompting for Contextual Medical QA with LLMs13 Jun 2025
- 2025An Intelligent Fault Self-Healing Mechanism for Cloud AI Systems via Integration of Large Language Models and Deep Reinforcement Learning9 Jun 2025
- 2025Anomaly Detection and Early Warning Mechanism for Intelligent Monitoring Systems in Multi-Cloud Environments Based on LLM9 Jun 2025
- 2025A Blueprint for AI-Driven Software Quality: Integrating LLMs with Established Standards19 May 2025
- 2025Cross-Cloud Data Privacy Protection: Optimizing Collaborative Mechanisms of AI Systems by Integrating Federated Learning and LLMs19 May 2025
- 2025Cloud-Based AI Systems: Leveraging Large Language Models for Intelligent Fault Detection and Autonomous Self-Healing16 May 2025
- 2025From Mind to Machine: The Rise of Manus AI as a Fully Autonomous Digital Agent4 May 2025
- 2025Data Augmentation Through Random Style Replacement14 Apr 2025