mlsanityData to 7 Oct 2026

Predicting Sustainable Development Goals Using Course Descriptions -- from LLMs to Conventional Foundation Models

arXiv 2402.16420 ↗First posted 26 Feb 2024cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

We present our work on predicting United Nations sustainable development goals (SDG) for university courses. We use an LLM named PaLM 2 to generate training data given a noisy human-authored course description input as input. We use this data to train several different smaller language models to predict SDGs for university courses. This work contributes to better university level adaptation of SDGs. The best performing model in our experiments was BART with an F1-score of 0.786.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 10 of its 20 references that are in the map. First posted on arXiv 26 Feb 2024.

Builds on

10 of 20 references.

References · 10

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  7. 2023PaLM 2 Technical Reportcited by 1,154
  8. 2014Distributed Representations of Sentences and Documentscited by 677
  9. 2022Bridging Fairness and Environmental Sustainability in Natural Language Processingcited by 5
  10. 2020Natural language processing for achieving sustainable development: the case of neural labelling to enhance community profilingcited by 4

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.