Detection of Criminal Texts for the Polish State Border Guard
Not on the map. Why?
Abstract (arXiv)
This paper describes research on the detection of Polish criminal texts appearing on the Internet. We carried out experiments to find the best available setup for the efficient classification of unbalanced and noisy data. The best performance was achieved when our model was fine-tuned on a pre-trained Polish-based transformer language model. For the detection task, a large corpus of annotated Internet snippets was collected as training data. We share this dataset and create a new task for the detection of criminal texts using the Gonito platform as the benchmark.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 19 references that are in the map. First posted on arXiv 24 Aug 2021.
Builds on
14 of 19 references.
References · 14
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2019How to Fine-Tune BERT for Text Classification?cited by 409
- 2020KLEJ: Comprehensive Benchmark for Polish Language Understandingcited by 51
- 2021HerBERT: Efficiently Pretrained Transformer-based Language Model for Polishcited by 51
2 more
- 2020Pre-training Polish Transformer-based Language Models at Scalecited by 21
- 2019Evaluation of Sentence Representations in Polishcited by 18
Built on by
Citing papers per year: 2026: 1.
1 paper.