mlsanityData to 14 Oct 2026

Large Language Models for Conducting Advanced Text Analytics Information Systems Research

arXiv 2312.17278 ↗First posted 27 Dec 2023cs.CL cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

The exponential growth of digital content has generated massive textual datasets, necessitating the use of advanced analytical approaches. Large Language Models (LLMs) have emerged as tools that are capable of processing and extracting insights from massive unstructured textual datasets. However, how to leverage LLMs for text analytics Information Systems (IS) research is currently unclear. To assist the IS community in understanding how to operationalize LLMs, we propose a Text Analytics for Information Systems Research (TAISR) framework. Our proposed framework provides detailed recommendations grounded in IS and LLM literature on how to conduct meaningful text analytics IS research for design science, behavioral, and econometric streams. We conducted three business intelligence case studies using our TAISR framework to demonstrate its application in several IS research contexts. We also outline the potential challenges and limitations of adopting LLMs for IS. By offering a systematic approach and evidence of its utility, our TAISR framework contributes to future IS research streams looking to incorporate powerful LLMs for text analytics.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 52 of its 122 references that are in the map. First posted on arXiv 27 Dec 2023.

Builds on

52 of 122 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2022Training language models to follow instructions with human feedbackcited by 15,971
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  9. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  10. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  11. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  12. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
38 more
  1. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  2. 2018Deep contextualized word representationscited by 2,290
  3. 2020Extracting Training Data from Large Language Modelscited by 2,189
  4. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  5. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  6. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  7. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  8. 2018Hierarchical Neural Story Generationcited by 1,193
  9. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
  10. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  11. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
  12. 2020Efficient Transformers: A Surveycited by 790
  13. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  14. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
  15. 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 713
  16. 2019Text Summarization with Pretrained Encoderscited by 556
  17. 2019Neural Text Generation with Unlikelihood Trainingcited by 503
  18. 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 470
  19. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
  20. 2018A Survey on Deep Transfer Learningcited by 419
  21. 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
  22. 2021All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Textcited by 287
  23. 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 285
  24. 2022A Contrastive Framework for Neural Text Generationcited by 225
  25. 2022Generating Training Data with Language Models: Towards Zero-Shot Language Understandingcited by 199
  26. 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 190
  27. 2021Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classificationcited by 183
  28. 2023GPT detectors are biased against non-native English writerscited by 178
  29. 2019Text Classification Algorithms: A Surveycited by 163
  30. 2022On the Effectiveness of Parameter-Efficient Fine-Tuningcited by 141
  31. 2022On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?cited by 138
  32. 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 129
  33. 2020A Survey of Knowledge-Enhanced Text Generationcited by 120
  34. 2021A Survey on Data Augmentation for Text Classificationcited by 111
  35. 2020Few-Shot Text Generation with Pattern-Exploiting Trainingcited by 87
  36. 2022A Survey of Knowledge Enhanced Pre-trained Language Modelscited by 76
  37. 2021Partial Is Better Than All: Revisiting Fine-tuning Strategy for Few-shot Learningcited by 72
  38. 2023GPT-Sentinel: Distinguishing Human and ChatGPT Generated Contentcited by 43

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.