BanglaLorica: Design and Evaluation of a Robust Watermarking Algorithm for Large Language Models in Bangla Text Generation
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
As large language models (LLMs) are increasingly deployed for text generation, watermarking has become essential for authorship attribution, intellectual property protection, and misuse detection. While existing watermarking methods perform well in high-resource languages, their robustness in low-resource languages remains underexplored. This work presents the first systematic evaluation of state-of-the-art text watermarking methods: KGW, Exponential Sampling (EXP), and Waterfall, for Bangla LLM text generation under cross-lingual round-trip translation (RTT) attacks. Under benign conditions, KGW and EXP achieve high detection accuracy (>88%) with negligible perplexity and ROUGE degradation. However, RTT causes detection accuracy to collapse below RTT causes detection accuracy to collapse to 9-13%, indicating a fundamental failure of token-level watermarking. To address this, we propose a layered watermarking strategy that combines embedding-time and post-generation watermarks. Experimental results show that layered watermarking improves post-RTT detection accuracy by 25-35%, achieving 40-50% accuracy, representing a 3× to 4× relative improvement over single-layer methods, at the cost of controlled semantic degradation. Our findings quantify the robustness-quality trade-off in multilingual watermarking and establish layered watermarking as a practical, training-free solution for low-resource languages such as Bangla. Our code and data will be made public.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 9 of its 15 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
9 of 15 references.
Closest ancestors · 5
Same direction, newest first
- 2023A Robust Semantics-based Watermark for Large Language Model against Paraphrasing15 Nov
- 2023Robust Distortion-free Watermarks for Language Models28 Jul
- 2023Watermarking Conditional Text Generation for AI Detection: Unveiling Challenges and a Semantic-Aware Watermark Remedy25 Jul
- 2023Robust Multi-bit Natural Language Watermarking through Invariant Features3 May
- 2021Protecting Intellectual Property of Language Generation APIs with Lexical Watermark5 Dec
Other references · 4
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023Baichuan 2: Open Large-scale Language Modelscited by 664
- 2020Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Datasets for Bengali-English Machine Translationcited by 53
- 2023BanglaBook: A Large-scale Bangla Dataset for Sentiment Analysis from Book Reviewscited by 14
Built on by
Not cited yet.