mlsanityData to 14 Oct 2026

Risk Assessment and Security Analysis of Large Language Models

arXiv 2508.17329 ↗First posted 24 Aug 2025cs.CRcited by 1

Not on the map. Why?

Abstract (arXiv)

As large language models (LLMs) expose systemic security challenges in high risk applications, including privacy leaks, bias amplification, and malicious abuse, there is an urgent need for a dynamic risk assessment and collaborative defence framework that covers their entire life cycle. This paper focuses on the security problems of large language models (LLMs) in critical application scenarios, such as the possibility of disclosure of user data, the deliberate input of harmful instructions, or the models bias. To solve these problems, we describe the design of a system for dynamic risk assessment and a hierarchical defence system that allows different levels of protection to cooperate. This paper presents a risk assessment system capable of evaluating both static and dynamic indicators simultaneously. It uses entropy weighting to calculate essential data, such as the frequency of sensitive words, whether the API call is typical, the realtime risk entropy value is significant, and the degree of context deviation. The experimental results show that the system is capable of identifying concealed attacks, such as role escape, and can perform rapid risk evaluation. The paper uses a hybrid model called BERT-CRF (Bidirectional Encoder Representation from Transformers) at the input layer to identify and filter malicious commands. The model layer uses dynamic adversarial training and differential privacy noise injection technology together. The output layer also has a neural watermarking system that can track the source of the content. In practice, the quality of this method, especially important in terms of customer service in the financial industry.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). First posted on arXiv 24 Aug 2025.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Attack and defense techniques in large language models: A survey and new perspectives
  2. 2024Risk and Response in Large Language Models: Evaluating Key Threat Categories
  3. 2025Data Security in Large Language Models: Risks, Defense, and Directions
  4. 2024Unique Security and Privacy Threats of Large Language Models: A Comprehensive Survey
  5. 2024Breaking Down the Defenses: A Comparative Survey of Attacks on Large Language Models
  6. 2024Threat Modelling and Risk Analysis for Large Language Model (LLM)-Powered Applications
  7. 2025A Survey on Privacy Risks and Protection in Large Language Models
  8. 2024Recent Advances in Attack and Defense Approaches of Large Language Models