A Large Self-Annotated Corpus for Sarcasm
Not on the map. Why?
Abstract (arXiv)
We introduce the Self-Annotated Reddit Corpus (SARC), a large corpus for sarcasm research and for training and evaluating systems for sarcasm detection. The corpus has 1.3 million sarcastic statements -- 10 times more than any previous dataset -- and many times more instances of non-sarcastic statements, allowing for learning in both balanced and unbalanced label regimes. Each statement is furthermore self-annotated -- sarcasm is labeled by the author, not an independent annotator -- and provided with user, topic, and conversation context. We evaluate the corpus for accuracy, construct benchmarks for sarcasm detection, and evaluate baseline methods.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 9; 2023: 12; 2024: 10; 2025: 15; 2026: 6.
63 papers.
Sort:
By area:
- 2025BIG-Bench Extra Hardcited by 123
- 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmarkcited by 62
- 2021Do Humans Trust Advice More if it Comes from AI? An Analysis of Human-AI Interactionscited by 35
- 2022A Multimodal Corpus for Emotion Recognition in Sarcasmcited by 29
- 2023Human-Aligned Calibration for AI-Assisted Decision Makingcited by 28
- 2022Uncalibrated Models Can Improve Human-AI Collaborationcited by 26
- 2024A Survey of Multimodal Sarcasm Detectioncited by 19
- 2021A Dual-Channel Framework for Sarcasm Recognition by Detecting Sentiment Conflictcited by 14
- 2022Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approachescited by 12
- 2023Source Attribution for Large Language Model-Generated Datacited by 11
- 2024Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligencecited by 11
- 2024SoMeLVLM: A Large Vision Language Model for Social Media Processingcited by 11
38 more
- 2025Large Language Models for Subjective Language Understanding: A Surveycited by 9
- 2021Reddit Entity Linking Datasetcited by 7
- 2023Sarcasm in Sight and Sound: Benchmarking and Expansion to Improve Multimodal Sarcasm Detectioncited by 7
- 2023On Sarcasm Detection with OpenAI GPT-based Modelscited by 7
- 2023DocMSU: A Comprehensive Benchmark for Document-level Multimodal Sarcasm Understandingcited by 7
- 2021Latent-Optimized Adversarial Neural Transfer for Sarcasm Detectioncited by 6
- 2021Sarcasm Detection: A Comparative Studycited by 6
- 2024Systematic Literature Review: Computational Approaches for Humour Style Classificationcited by 6
- 2024Generalizable Sarcasm Detection Is Just Around The Corner, Of Course!cited by 5
- 2024BESSTIE: A Benchmark for Sentiment and Sarcasm Classification for Varieties of Englishcited by 5
- 2022Cyclical Curriculum Learningcited by 4
- 2023Meta-Tuning LLMs to Leverage Lexical Knowledge for Generalizable Language Style Understandingcited by 4
- 2025ContextLeak: Auditing Leakage in Private In-Context Learning Methodscited by 4
- 2022A Survey on Automated Sarcasm Detection on Twittercited by 3
- 2022ConFiguRe: Exploring Discourse-level Chinese Figures of Speechcited by 3
- 2023An Evaluation of State-of-the-Art Large Language Models for Sarcasm Detectioncited by 3
- 2025Perspective Transition of Large Language Models for Solving Subjective Taskscited by 3
- 2021Impact of Target Word and Context on End-to-End Metonymy Detectioncited by 2
- 2022Computational Sarcasm Analysis on Social Media: A Systematic Reviewcited by 2
- 2022Sarcasm Detection Framework Using Context, Emotion and Sentiment Featurescited by 2
- 2023Assorted, Archetypal and Annotated Two Million (3A2M) Cooking Recipes Dataset based on Active Learningcited by 2
- 2024KoCoSa: Korean Context-aware Sarcasm Detection Datasetcited by 2
- 2021MagicPai at SemEval-2021 Task 7: Method for Detecting and Rating Humor Based on Multi-Task Adversarial Trainingcited by 1
- 2021Parallel Deep Learning-Driven Sarcasm Detection from Pop Culture Text and English Humor Literaturecited by 1
- 2023"When Words Fail, Emojis Prevail": Generating Sarcastic Utterances with Emoji Using Valence Reversal and Semantic Incongruitycited by 1
- 2023Sarcasm Detection in a Disaster Contextcited by 1
- 2024Emotional RAG LLMs: Reading Comprehension for the Open Internetcited by 1
- 2025Evaluating Large Language Models Against Human Annotators in Latent Content Analysis: Sentiment, Political Leaning, Emotional Intensity, and Sarcasmcited by 1
- 2025Intermediate-Task Transfer Learning: Leveraging Sarcasm Detection for Stance Detectioncited by 1
- 2025Sarcasm Detection as a Catalyst: Improving Stance Detection with Cross-Target Capabilitiescited by 1
- 2025A Transformer and Prototype-based Interpretable Model for Contextual Sarcasm Detectioncited by 1
- 2026Emotion is Not Just a Label: Latent Emotional Factors in LLM Processingcited by 1
- 2026ProSarc: Prosody-Aware Sarcasm Recognition Framework via Temporal Prosodic Incongruitycited by 1
- 2021Interpretable Multi-Head Self-Attention model for Sarcasm Detection in social mediacited by 0
- 2021Integrating extracted information from bert and multiple embedding methods with the deep neural network for humour detectioncited by 0
- 2021SASICM A Multi-Task Benchmark For Subtext Recognitioncited by 0
- 2022Finetuning for Sarcasm Detection with a Pruned Datasetcited by 0
- 2023Researchers eye-view of sarcasm detection in social media textual contentcited by 0
50 most cited of 63 All 63 (JSON)
- 2026ProSarc: Prosody-Aware Sarcasm Recognition Framework via Temporal Prosodic Incongruity4 Jun 2026
- 2026Emotion is Not Just a Label: Latent Emotional Factors in LLM Processing10 Mar 2026
- 2026DEBISS: a Corpus of Individual, Semi-structured and Spoken Debates5 Mar 2026
- 2026Yor-Sarc: A gold-standard dataset for sarcasm detection in a low-resource African language21 Feb 2026
- 2026CEI: A Benchmark for Evaluating Pragmatic Reasoning in Language Models14 Feb 2026
- 2026LLMs-Integrated Automatic Hate Speech Recognition Using Controllable Text Generation Models8 Jan 2026
- 2025ContextLeak: Auditing Leakage in Private In-Context Learning Methods18 Dec 2025
- 2025SocialNLI: A Dialogue-Centric Social Inference Dataset6 Oct 2025
- 2025SeLeRoSa: Sentence-Level Romanian Satire Detection Dataset31 Aug 2025
- 2025Transfer Learning via Lexical Relatedness: A Sarcasm and Hate Speech Case Study22 Aug 2025
- 2025Large Language Models for Subjective Language Understanding: A Survey11 Aug 2025
- 2025PromptAug: Fine-grained Conflict Classification Using Data Augmentation24 Jun 2025
38 more
- 2025MuSaRoNews: A Multidomain, Multimodal Satire Dataset from Romanian News Articles10 Apr 2025
- 2025SaRoHead: Detecting Satire in a Multi-Domain Romanian News Headline Dataset10 Apr 2025
- 2025Assessing how hyperparameters impact Large Language Models' sarcasm detection performance8 Apr 2025
- 2025A Transformer and Prototype-based Interpretable Model for Contextual Sarcasm Detection14 Mar 2025
- 2025Sarcasm Detection as a Catalyst: Improving Stance Detection with Cross-Target Capabilities5 Mar 2025
- 2025Intermediate-Task Transfer Learning: Leveraging Sarcasm Detection for Stance Detection5 Mar 2025
- 2025BIG-Bench Extra Hard26 Feb 2025
- 2025Perspective Transition of Large Language Models for Solving Subjective Tasks16 Jan 2025
- 2025Evaluating Large Language Models Against Human Annotators in Latent Content Analysis: Sentiment, Political Leaning, Emotional Intensity, and Sarcasm5 Jan 2025
- 2024"My life is miserable, have to sign 500 autographs everyday": Exposing Humblebragging, the Brags in Disguise28 Dec 2024
- 2024BESSTIE: A Benchmark for Sentiment and Sarcasm Classification for Varieties of English6 Dec 2024
- 2024Was that Sarcasm?: A Literature Survey on Sarcasm Detection30 Nov 2024
- 2024A Survey of Multimodal Sarcasm Detection24 Oct 2024
- 2024Emotional RAG LLMs: Reading Comprehension for the Open Internet20 Aug 2024
- 2024Generalizable Sarcasm Detection Is Just Around The Corner, Of Course!9 Apr 2024
- 2024KoCoSa: Korean Context-aware Sarcasm Detection Dataset22 Feb 2024
- 2024SoMeLVLM: A Large Vision Language Model for Social Media Processing20 Feb 2024
- 2024Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence15 Feb 2024
- 2024Systematic Literature Review: Computational Approaches for Humour Style Classification30 Jan 2024
- 2023DocMSU: A Comprehensive Benchmark for Document-level Multimodal Sarcasm Understanding26 Dec 2023
- 2023On Sarcasm Detection with OpenAI GPT-based Models7 Dec 2023
- 2023An Evaluation of State-of-the-Art Large Language Models for Sarcasm Detection7 Oct 2023
- 2023Source Attribution for Large Language Model-Generated Data1 Oct 2023
- 2023Sarcasm in Sight and Sound: Benchmarking and Expansion to Improve Multimodal Sarcasm Detection29 Sep 2023
- 2023Sarcasm Detection in a Disaster Context16 Aug 2023
- 2023Human-Aligned Calibration for AI-Assisted Decision Making31 May 2023
- 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark24 May 2023
- 2023Meta-Tuning LLMs to Leverage Lexical Knowledge for Generalizable Language Style Understanding24 May 2023
- 2023"When Words Fail, Emojis Prevail": Generating Sarcastic Utterances with Emoji Using Valence Reversal and Semantic Incongruity6 May 2023
- 2023Researchers eye-view of sarcasm detection in social media textual content17 Apr 2023
- 2023Assorted, Archetypal and Annotated Two Million (3A2M) Cooking Recipes Dataset based on Active Learning27 Mar 2023
- 2022Finetuning for Sarcasm Detection with a Pruned Dataset23 Dec 2022
- 2022Sarcasm Detection Framework Using Context, Emotion and Sentiment Features23 Nov 2022
- 2022Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approaches15 Nov 2022
- 2022ConFiguRe: Exploring Discourse-level Chinese Figures of Speech16 Sep 2022
- 2022Computational Sarcasm Analysis on Social Media: A Systematic Review13 Sep 2022
- 2022A Multimodal Corpus for Emotion Recognition in Sarcasm5 Jun 2022
- 2022Uncalibrated Models Can Improve Human-AI Collaboration12 Feb 2022
50 newest of 63 All 63 (JSON)
- 2025BIG-Bench Extra Hardcited by 123
- 2026Emotion is Not Just a Label: Latent Emotional Factors in LLM Processingcited by 1
- 2026CEI: A Benchmark for Evaluating Pragmatic Reasoning in Language Modelscited by 0
- 2026Emotion is Not Just a Label: Latent Emotional Factors in LLM Processing10 Mar 2026
- 2026CEI: A Benchmark for Evaluating Pragmatic Reasoning in Language Models14 Feb 2026
- 2025BIG-Bench Extra Hard26 Feb 2025
- 2023Source Attribution for Large Language Model-Generated Datacited by 11
- 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmarkcited by 62
- 2021Do Humans Trust Advice More if it Comes from AI? An Analysis of Human-AI Interactionscited by 35
- 2022A Multimodal Corpus for Emotion Recognition in Sarcasmcited by 29
- 2023Human-Aligned Calibration for AI-Assisted Decision Makingcited by 28
- 2022Uncalibrated Models Can Improve Human-AI Collaborationcited by 26
- 2024A Survey of Multimodal Sarcasm Detectioncited by 19
- 2021A Dual-Channel Framework for Sarcasm Recognition by Detecting Sentiment Conflictcited by 14
- 2022Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approachescited by 12
- 2024Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligencecited by 11
- 2025Large Language Models for Subjective Language Understanding: A Surveycited by 9
- 2021Reddit Entity Linking Datasetcited by 7
- 2023Sarcasm in Sight and Sound: Benchmarking and Expansion to Improve Multimodal Sarcasm Detectioncited by 7
12 most cited of 58 All 58 (JSON)
- 2026ProSarc: Prosody-Aware Sarcasm Recognition Framework via Temporal Prosodic Incongruity4 Jun 2026
- 2026DEBISS: a Corpus of Individual, Semi-structured and Spoken Debates5 Mar 2026
- 2026Yor-Sarc: A gold-standard dataset for sarcasm detection in a low-resource African language21 Feb 2026
- 2026LLMs-Integrated Automatic Hate Speech Recognition Using Controllable Text Generation Models8 Jan 2026
- 2025ContextLeak: Auditing Leakage in Private In-Context Learning Methods18 Dec 2025
- 2025SocialNLI: A Dialogue-Centric Social Inference Dataset6 Oct 2025
- 2025SeLeRoSa: Sentence-Level Romanian Satire Detection Dataset31 Aug 2025
- 2025Transfer Learning via Lexical Relatedness: A Sarcasm and Hate Speech Case Study22 Aug 2025
- 2025Large Language Models for Subjective Language Understanding: A Survey11 Aug 2025
- 2025PromptAug: Fine-grained Conflict Classification Using Data Augmentation24 Jun 2025
- 2025MuSaRoNews: A Multidomain, Multimodal Satire Dataset from Romanian News Articles10 Apr 2025
- 2025SaRoHead: Detecting Satire in a Multi-Domain Romanian News Headline Dataset10 Apr 2025
12 newest of 58 All 58 (JSON)