mlsanityData to 14 Oct 2026

BanglaVeilGuard: Cross-Script Safety Benchmarking and Lightweight Guardrails for Bangla Large Language Models

arXiv 2608.21880 ↗First posted 22 Aug 2026cs.CL cs.CRcited by 0

On the map: LLM safety and security → Safety alignment, refusal and guardrails

Abstract (arXiv)

Bangla large language model (LLM) safety is difficult to evaluate with English-centric or standard-script benchmarks because Bangla users routinely write across scripts, spellings, code-mixed forms, and regional registers. This paper presents BanglaVeilGuard, a compact Bangla-first safety benchmark and lightweight prompt guard for six language forms: standard Bangla, Romanized Bangla, Banglish, code-mixed Bangla--English, noisy Bangla, and dialectal Bangla. The benchmark contains 2,366 quality-filtered prompts and a held-out 354-prompt evaluation split spanning unsafe, safe, and safe-sensitive requests. BanglaVeilGuard uses non-destructive multi-view normalization with a prompt-risk classifier and thresholded pre-generation gate, allowing it to screen prompts for heterogeneous target models without changing their weights. Across target-model families, guarded runs reduce attack success under deterministic response scoring from 93.8--100.0% to 6.3% for Claude Opus 4.8, BanglaLLama, and TituLLM; TigerLLM-1B with BanglaVeilGuard achieves 78.2% accuracy with 8.8% ASR. The prompt guard also attains 88.5% unsafe recall, substantially above the evaluated prompt-only guard baselines. The main remaining cost is over-refusal on dialectal and noisy benign prompts, revealing a concrete safety-helpfulness frontier for Bangla LLM deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 3 of its 14 references that are in the map. First posted on arXiv 22 Aug 2026.

Builds on

3 of 14 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating It30 May

Other references · 2

  1. 2025CultureGuard: Towards Culturally-Aware Dataset and Guard Model for Multilingual Safety Applicationscited by 27
  2. 2025A Framework to Assess Multilingual Vulnerabilities of LLMscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025X-Guard: Multilingual Guard Agent for Content Moderation
  2. 2025MrGuard: A Multilingual Reasoning Guardrail for Universal LLM Safety
  3. 2026SurakshaEval: An Indic Safety Benchmark for Multilingual LLMs
  4. 2025SEALGuard: Safeguarding the Multilingual Conversations in Southeast Asian Languages for LLM Software Systems
  5. 2026Register Shifts Break LLM Safety: A Bengali Benchmark with Culturally Grounded Harms
  6. 2024SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Models
  7. 2025OpenGuardrails: A Configurable, Unified, and Scalable Guardrails Platform for Large Language Models
  8. 2025Auto-Tuning Safety Guardrails for Black-Box Large Language Models