mlsanityData to 14 Oct 2026

EaSyGuide : ESG Issue Identification Framework leveraging Abilities of Generative Large Language Models

arXiv 2306.06662 ↗First posted 11 Jun 2023cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper presents our participation in the FinNLP-2023 shared task on multi-lingual environmental, social, and corporate governance issue identification (ML-ESG). The task's objective is to classify news articles based on the 35 ESG key issues defined by the MSCI ESG rating guidelines. Our approach focuses on the English and French subtasks, employing the CerebrasGPT, OPT, and Pythia models, along with the zero-shot and GPT3Mix Augmentation techniques. We utilize various encoder models, such as RoBERTa, DeBERTa, and FinBERT, subjecting them to knowledge distillation and additional training. Our approach yielded exceptional results, securing the first position in the English text subtask with F1-score 0.69 and the second position in the French text subtask with F1-score 0.78. These outcomes underscore the effectiveness of our methodology in identifying ESG issues in news articles across different languages. Our findings contribute to the exploration of ESG topics and highlight the potential of leveraging advanced language models for ESG issue identification.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 22 references that are in the map. First posted on arXiv 11 Jun 2023.

Builds on

10 of 22 references.

References · 10

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  2. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  3. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  4. 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,786
  5. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  6. 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 538
  7. 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 385
  8. 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 187
  9. 2023Cerebras-GPT: Open Compute-Optimal Language Models Trained on the Cerebras Wafer-Scale Clustercited by 109
  10. 2021Larger-Scale Transformers for Multilingual Masked Language Modelingcited by 87

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Empirical Evaluation of Open-Source Large Language Models for Retrieval-Augmented Generation in ESG Domain
  2. 2026Benchmarking Embedding Models for ESG Data ↗
  3. 2025Enhancing Retrieval for ESGLLM via ESG-CID -- A Disclosure Content Index Finetuning Dataset for Mapping GRI and ESRS
  4. 2025ESGenius: Benchmarking LLMs on Environmental, Social, and Governance (ESG) and Sustainability Knowledge
  5. 2025MMESGBench: Pioneering Multimodal Understanding and Complex Reasoning Benchmark for ESG Tasks
  6. 2024SusGen-GPT: A Data-Centric LLM for Financial NLP and Sustainability Report Generation
  7. 2026Advancing ESG Intelligence: An Expert-level Agent and Comprehensive Benchmark for Sustainable Finance
  8. 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Models