VietBinoculars: A Zero-Shot Approach for Detecting Vietnamese LLM-Generated Text
Not on the map. Why?
Abstract (arXiv)
The rapid proliferation of Large Language Models has intensified the challenge of distinguishing LLM-generated text from human writing in non-English languages. This study introduces VietBinoculars, a zero-shot detection framework coupling PhoGPT-4B observer and performer models with calibrated global decision thresholds. By utilizing specialized Vietnamese BPE tokenization, the method eliminates byte-level fragmentation and probability dilution common in massive multilingual backbones. Evaluated across multi-domain benchmarks, VietBinoculars achieves an area under the ROC curve exceeding 0.99. Under optimal Youden's J thresholds and greedy decoding, detection accuracy reaches at least 98.78%, while significantly outperforming baseline Binoculars, zero-shot detectors, and commercial tools on creative Capybara prompts. Even under a strict false positive rate constraint of 0.06%, the detector maintains F1-scores between 83.15% and 94.70%. Detection performance consistently improves with sequence length, stabilizing at optimal accuracy for passages containing 450 to 550 tokens. Extended stress testing across 48 distinct model-decoding configurations and three post-generation rewriting strategies delineates practical operational boundaries. VietBinoculars exhibits robust resilience against single-pass paraphrasing and human-style revisions, but experiences notable performance degradation under high-entropy sampling and iterative double paraphrasing.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 27 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
19 of 27 references.
References · 19
- 2017Attention Is All You Needcited by 60,361
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2025Gemma 3 Technical Reportcited by 1,824
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 713
- 2019Defending Against Neural Fake Newscited by 559
- 2023The Falcon Series of Open Language Modelscited by 535
- 2019Release Strategies and the Social Impacts of Language Modelscited by 513
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
7 more
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
- 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 190
- 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 91
- 2025Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMscited by 18
- 2020Limits of Detecting Text Generated by Large-Scale Language Modelscited by 15
- 2023PhoGPT: Generative Pre-training for Vietnamesecited by 8
- 2021Clustering Vietnamese Conversations From Facebook Page To Build Training Dataset For Chatbotcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.