# Investigating Chain-of-thought with ChatGPT for Stance Detection on Social Media

arXiv: https://arxiv.org/abs/2304.03087 · HTML: https://mlsanity.com/paper/2304.03087/

## Key facts

- Cited by 23 papers in the map (data through 14 Oct 2026).
- Placed in Causal reasoning in LLMs, one of 17 directions in LLM reasoning.
- Builds on 13 of its 24 references that are in the map.
- First posted on arXiv 6 Apr 2023.

## Placed in

- LLM reasoning / [Causal reasoning in LLMs](https://mlsanity.com/lr/causal-reasoning-in-llms/)

## Builds on (most cited first, 13 of 13)

- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [Emergent Abilities of Large Language Models](https://mlsanity.com/paper/2206.07682/) (2022)
- [Least-to-Most Prompting Enables Complex Reasoning in Large Language Models](https://mlsanity.com/paper/2205.10625/) (2022)
- [Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representations](https://mlsanity.com/paper/2010.03640/) (2020)
- [Stance Detection on Social Media: State of the Art and Trends](https://mlsanity.com/paper/2006.03644/) (2020)
- [Successive Prompting for Decomposing Complex Questions](https://mlsanity.com/paper/2212.04092/) (2022)
- [Stance Detection with Bidirectional Conditional Encoding](https://mlsanity.com/paper/1606.05464/) (2016)
- [Aspect Level Sentiment Classification with Deep Memory Network](https://mlsanity.com/paper/1605.08900/) (2016)
- [BertGCN: Transductive Text Classification by Combining GCN and BERT](https://mlsanity.com/paper/2105.05727/) (2021)
- [Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networks](https://mlsanity.com/paper/1909.03477/) (2019)
- [Cross-Target Stance Classification with Self-Attention Networks](https://mlsanity.com/paper/1805.06593/) (2018)
- [Aspect Level Sentiment Classification with Attention-over-Attention Neural Networks](https://mlsanity.com/paper/1804.06536/) (2018)
- [Topical Stance Detection for Twitter: A Two-Phase LSTM Model Using Attention](https://mlsanity.com/paper/1801.03032/) (2018)

## Built on by (most cited first, 23 of 23)

- [Stance Detection with Collaborative Role-Infused LLM-Based Agents](https://mlsanity.com/paper/2310.10467/) (2023)
- [A Survey of Prompt Engineering Methods in Large Language Models for Different NLP Tasks](https://mlsanity.com/paper/2407.12994/) (2024)
- [An In-depth Survey of Large Language Model-based Artificial Intelligence Agents](https://mlsanity.com/paper/2309.14365/) (2023)
- [Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models](https://mlsanity.com/paper/2308.10462/) (2023)
- [Prompting and Fine-Tuning Open-Sourced Large Language Models for Stance Classification](https://mlsanity.com/paper/2309.13734/) (2023)
- [Machine-assisted quantitizing designs: augmenting humanities and social sciences with artificial intelligence](https://mlsanity.com/paper/2309.14379/) (2023)
- [Chain-of-Thought Embeddings for Stance Detection on Social Media](https://mlsanity.com/paper/2310.19750/) (2023)
- [Stance Reasoner: Zero-Shot Stance Detection on Social Media with Explicit Reasoning](https://mlsanity.com/paper/2403.14895/) (2024)
- [Cross-target Stance Detection by Exploiting Target Analytical Perspectives](https://mlsanity.com/paper/2401.01761/) (2024)
- [DuSEGO: Dual Second-order Equivariant Graph Ordinary Differential Equation](https://mlsanity.com/paper/2411.10000/) (2024)
- [Reasoning in Conversation: Solving Subjective Tasks through Dialogue Simulation for Large Language Models](https://mlsanity.com/paper/2402.17226/) (2024)
- [Ladder-of-Thought: Using Knowledge as Steps to Elevate Stance Detection](https://mlsanity.com/paper/2308.16763/) (2023)
- [Speak It Out: Solving Symbol-Related Problems with Symbol-to-Language Conversion for Language Models](https://mlsanity.com/paper/2401.11725/) (2024)
- [Collaborative Knowledge Infusion for Low-resource Stance Detection](https://mlsanity.com/paper/2403.19219/) (2024)
- [A Logically Consistent Chain-of-Thought Approach for Stance Detection](https://mlsanity.com/paper/2312.16054/) (2023)
- [DIVERSE: A Dataset of YouTube Video Comment Stances with a Data Programming Model](https://mlsanity.com/paper/2403.03334/) (2024)
- [Collaborative Stance Detection via Small-Large Language Model Consistency Verification](https://mlsanity.com/paper/2502.19954/) (2025)
- [Mapping the Italian Telegram Ecosystem: Communities, Toxicity, and Hate Speech](https://mlsanity.com/paper/2504.19594/) (2025)
- [Scalable Attribute-Missing Graph Clustering via Neighborhood Differentiation](https://mlsanity.com/paper/2507.13368/) (2025)
- [Entity-Aware Self-Attention and Contextualized GCN for Enhanced Relation Extraction in Long Sentences](https://mlsanity.com/paper/2409.13755/) (2024)
- [A More Advanced Group Polarization Measurement Approach Based on LLM-Based Agents and Graphs](https://mlsanity.com/paper/2411.12196/) (2024)
- [Induce, Align, Predict: Zero-Shot Stance Detection via Cognitive Inductive Reasoning](https://mlsanity.com/paper/2506.13470/) (2025)
- [PRISM of Opinions: A Persona-Reasoned Multimodal Framework for User-centric Conversational Stance Detection](https://mlsanity.com/paper/2511.12130/) (2025)

## Abstract (arXiv)

Stance detection predicts attitudes towards targets in texts and has gained attention with the rise of social media. Traditional approaches include conventional machine learning, early deep neural networks, and pre-trained fine-tuning models. However, with the evolution of very large pre-trained language models (VLPLMs) like ChatGPT (GPT-3.5), traditional methods face deployment challenges. The parameter-free Chain-of-Thought (CoT) approach, not requiring backpropagation training, has emerged as a promising alternative. This paper examines CoT's effectiveness in stance detection tasks, demonstrating its superior accuracy and discussing associated challenges.
