Opinion Mining Using Population-tuned Generative Language Models
Not on the map. Why?
Abstract (arXiv)
We present a novel method for mining opinions from text collections using generative language models trained on data collected from different populations. We describe the basic definitions, methodology and a generic algorithm for opinion insight mining. We demonstrate the performance of our method in an experiment where a pre-trained generative model is fine-tuned using specifically tailored content with unnatural and fully annotated opinions. We show that our approach can learn and transfer the opinions to the semantic classes while maintaining the proportion of polarisation. Finally, we demonstrate the usage of an insight mining system to scale up the discovery of opinion insights from a real text corpus.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 29 references that are in the map. First posted on arXiv 24 Jul 2023.
Builds on
15 of 29 references.
References · 15
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 540
- 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 294
- 2022Fine-tuning language models to find agreement among humans with diverse preferencescited by 189
- 2020Towards Controllable Biases in Language Generationcited by 112
- 2021Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarizationcited by 76
- 2019Patent Claim Generation by Fine-Tuning OpenAI GPT-2cited by 49
Built on by
Not cited yet.