mlsanityData to 14 Oct 2026

Environmental, Social and Governance Sentiment Analysis on Slovene News: A Novel Dataset and Models

arXiv 2604.06826 ↗First posted 8 Apr 2026cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Environmental, Social, and Governance (ESG) considerations are increasingly integral to assessing corporate performance, reputation, and long-term sustainability. Yet, reliable ESG ratings remain limited for smaller companies and emerging markets. We introduce the first publicly available Slovene ESG sentiment dataset and a suite of models for automatic ESG sentiment detection. The dataset, derived from the MaCoCu Slovene news collection, combines large language model (LLM)-assisted filtering with human annotation of company-related ESG content. We evaluate the performance of monolingual (SloBERTa) and multilingual (XLM-R) models, embedding-based classifiers (TabPFN), hierarchical ensemble architectures, and large language models. Results show that LLMs achieve the strongest performance on Environmental (Gemma3-27B, F1-macro: 0.61) and Social aspects (gpt-oss 20B, F1-macro: 0.45), while fine-tuned SloBERTa is the best model on Governance classification (F1-macro: 0.54). We then show in a small case study how the best-preforming classifier (gpt-oss) can be applied to investigate ESG aspects for selected companies across a long time frame.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 28 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

9 of 28 references.

References · 9

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  4. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  5. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  6. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 674
  7. 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 385
  8. 2022ESGBERT: Language Model to Help with Classification Tasks Related to Companies Environmental, Social, and Governance Practicescited by 11
  9. 2024LLM Teacher-Student Framework for Text Classification With No Manually Annotated Data: A Case Study in IPTC News Topic Classificationcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.