Large Language Models for Conducting Advanced Text Analytics Information Systems Research
Not on the map. Why?
Abstract (arXiv)
The exponential growth of digital content has generated massive textual datasets, necessitating the use of advanced analytical approaches. Large Language Models (LLMs) have emerged as tools that are capable of processing and extracting insights from massive unstructured textual datasets. However, how to leverage LLMs for text analytics Information Systems (IS) research is currently unclear. To assist the IS community in understanding how to operationalize LLMs, we propose a Text Analytics for Information Systems Research (TAISR) framework. Our proposed framework provides detailed recommendations grounded in IS and LLM literature on how to conduct meaningful text analytics IS research for design science, behavioral, and econometric streams. We conducted three business intelligence case studies using our TAISR framework to demonstrate its application in several IS research contexts. We also outline the potential challenges and limitations of adopting LLMs for IS. By offering a systematic approach and evidence of its utility, our TAISR framework contributes to future IS research streams looking to incorporate powerful LLMs for text analytics.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 52 of its 122 references that are in the map. First posted on arXiv 27 Dec 2023.
Builds on
52 of 122 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
38 more
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2018Deep contextualized word representationscited by 2,290
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
- 2020Efficient Transformers: A Surveycited by 790
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
- 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 713
- 2019Text Summarization with Pretrained Encoderscited by 556
- 2019Neural Text Generation with Unlikelihood Trainingcited by 503
- 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 470
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
- 2018A Survey on Deep Transfer Learningcited by 419
- 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
- 2021All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Textcited by 287
- 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 285
- 2022A Contrastive Framework for Neural Text Generationcited by 225
- 2022Generating Training Data with Language Models: Towards Zero-Shot Language Understandingcited by 199
- 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 190
- 2021Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classificationcited by 183
- 2023GPT detectors are biased against non-native English writerscited by 178
- 2019Text Classification Algorithms: A Surveycited by 163
- 2022On the Effectiveness of Parameter-Efficient Fine-Tuningcited by 141
- 2022On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?cited by 138
- 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 129
- 2020A Survey of Knowledge-Enhanced Text Generationcited by 120
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2020Few-Shot Text Generation with Pattern-Exploiting Trainingcited by 87
- 2022A Survey of Knowledge Enhanced Pre-trained Language Modelscited by 76
- 2021Partial Is Better Than All: Revisiting Fine-tuning Strategy for Few-shot Learningcited by 72
- 2023GPT-Sentinel: Distinguishing Human and ChatGPT Generated Contentcited by 43
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2024: 1.
1 paper.