mlsanityData to 7 Oct 2026

Using contextual sentence analysis models to recognize ESG concepts

arXiv 2207.01402 ↗First posted 4 Jul 2022cs.CL cs.LG q-fin.GNcited by 5

Not on the map. Why?

Abstract (arXiv)

This paper summarizes the joint participation of the Trading Central Labs and the L3i laboratory of the University of La Rochelle on both sub-tasks of the Shared Task FinSim-4 evaluation campaign. The first sub-task aims to enrich the 'Fortia ESG taxonomy' with new lexicon entries while the second one aims to classify sentences to either 'sustainable' or 'unsustainable' with respect to ESG (Environment, Social and Governance) related factors. For the first sub-task, we proposed a model based on pre-trained Sentence-BERT models to project sentences and concepts in a common space in order to better represent ESG concepts. The official task results show that our system yields a significant performance improvement compared to the baseline and outperforms all other submissions on the first sub-task. For the second sub-task, we combine the RoBERTa model with a feed-forward multi-layer perceptron in order to extract the context of sentences and classify them. Our model achieved high accuracy scores (over 92%) and was ranked among the top 5 systems.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 9 of its 16 references that are in the map. First posted on arXiv 4 Jul 2022.

Builds on

9 of 16 references.

References · 9

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  5. 2019Commonsense Knowledge Base Completion with Structural and Semantic Contextcited by 61
  6. 2020TaxoExpan: Self-supervised Taxonomy Expansion with Position-Enhanced Graph Neural Networkcited by 37
  7. 2020TXtract: Taxonomy-Aware Knowledge Extraction for Thousands of Product Categoriescited by 29
  8. 2018Predicting the Semantic Textual Similarity with Siamese CNN and LSTMcited by 14
  9. 2021A Hybrid Approach to Measure Semantic Relatedness in Biomedical Conceptscited by 5

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 2; 2025: 1.

5 papers.

  1. 2023When Does Aggregating Multiple Skills with Multi-Task Learning Work? A Case Study in Financial NLPcited by 5
  2. 2023Leveraging BERT Language Models for Multi-Lingual ESG Issue Identificationcited by 2
  3. 2024Enhancing ESG Impact Type Identification through Early Fusion and Multilingual Modelscited by 0
  4. 2024Forecasting Four Business Cycle Phases Using Machine Learning: A Case Study of US and EuroZonecited by 0
  5. 2025Improving Clustering on Occupational Text Data through Dimensionality Reductioncited by 0