Contextual Sentence Classification: Detecting Sustainability Initiatives in Company Reports
Not on the map. Why?
Abstract (arXiv)
We introduce the novel task of detecting sustainability initiatives in company reports. Given a full report, the aim is to automatically identify mentions of practical activities that a company has performed in order to tackle specific societal issues. New methods for identifying continuous sentence spans need to be developed for capturing the multi-sentence structure of individual sustainability initiatives. We release a new dataset of company reports in which the text has been manually annotated with sustainability initiatives. We also evaluate different models for initiative detection, introducing a novel aggregation and evaluation methodology. Our proposed architecture uses sequences of consecutive sentences to account for contextual information when making classification decisions at the individual sentence level.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 23 references that are in the map. First posted on arXiv 7 Oct 2021.
Builds on
11 of 23 references.
References · 11
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
- 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 486
- 2020Exploring Cross-sentence Contexts for Named Entity Recognition with BERTcited by 27
- 2020iobes: A Library for Span-Level Processingcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.