Humor@IITK at SemEval-2021 Task 7: Large Language Models for Quantifying Humor and Offensiveness
Not on the map. Why?
Abstract (arXiv)
Humor and Offense are highly subjective due to multiple word senses, cultural knowledge, and pragmatic competence. Hence, accurately detecting humorous and offensive texts has several compelling use cases in Recommendation Systems and Personalized Content Moderation. However, due to the lack of an extensive labeled dataset, most prior works in this domain haven't explored large neural models for subjective humor understanding. This paper explores whether large neural models and their ensembles can capture the intricacies associated with humor/offense detection and rating. Our experiments on the SemEval-2021 Task 7: HaHackathon show that we can develop reasonable humor and offense detection systems with such models. Our models are ranked third in subtask 1b and consistently ranked around the top 33% of the leaderboard for the remaining subtasks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 34 references that are in the map. First posted on arXiv 2 Apr 2021.
Builds on
24 of 34 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
12 more
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
- 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
- 2019ERNIE 2.0: A Continual Pre-training Framework for Language Understandingcited by 230
- 2019Exploiting BERT for End-to-End Aspect-based Sentiment Analysiscited by 57
- 2019Affect-Driven Dialog Generationcited by 50
- 2019Humor Detection: A Transformer Gets the Last Laughcited by 46
- 2020Adapting a Language Model for Controlled Affective Text Generationcited by 22
- 2021An End-to-End Network for Emotion-Cause Pair Extractioncited by 15
- 2020"The Boating Store Had Its Best Sail Ever": Pronunciation-attentive Contextualized Pun Recognitioncited by 9
- 2019SentiLARE: Sentiment-Aware Language Representation Learning with Linguistic Knowledgecited by 1
- 2020JokeMeter at SemEval-2020 Task 7: Convolutional humorcited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.