TILFA: A Unified Framework for Text, Image, and Layout Fusion in Argument Mining
Not on the map. Why?
Abstract (arXiv)
A main goal of Argument Mining (AM) is to analyze an author's stance. Unlike previous AM datasets focusing only on text, the shared task at the 10th Workshop on Argument Mining introduces a dataset including both text and images. Importantly, these images contain both visual elements and optical characters. Our new framework, TILFA (A Unified Framework for Text, Image, and Layout Fusion in Argument Mining), is designed to handle this mixed data. It excels at not only understanding text but also detecting optical characters and recognizing layout details in images. Our model significantly outperforms existing baselines, earning our team, KnowComp, the 1st place in the leaderboard of Argumentative Stance Classification subtask in this shared task.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 8 Oct 2023.
Builds on
23 of 32 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
- 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 408
- 2016Enhanced LSTM for Natural Language Inferencecited by 200
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2022A Comprehensive Survey of Image Augmentation Techniques for Deep Learningcited by 97
- 2019Graph Convolution for Multimodal Information Extraction from Visually Rich Documentscited by 88
- 2019GlossBERT: BERT for Word Sense Disambiguation with Gloss Knowledgecited by 79
- 2016Argumentation Mining in User-Generated Web Discoursecited by 69
- 2023Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluationcited by 69
11 more
- 2023CAR: Conceptualization-Augmented Reasoner for Zero-Shot Commonsense Question Answeringcited by 28
- 2023CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoningcited by 25
- 2023COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspectivecited by 22
- 2023Incomplete Multi-View Multi-Label Learning via Label-Guided Masked View- and Category-Aware Transformerscited by 17
- 2022ROCK: Causal Inference Principles for Reasoning about Commonsense Causalitycited by 16
- 2023Getting Sick After Seeing a Doctor? Diagnosing and Mitigating Knowledge Conflicts in Event Temporal Reasoningcited by 13
- 2022ImageArg: A Multi-modal Tweet Dataset for Image Persuasiveness Miningcited by 12
- 2023A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Cluescited by 11
- 2022SubeventWriter: Iterative Sub-event Sequence Generation with Coherence Controllercited by 10
- 2022Chunk-aware Alignment and Lexical Constraint for Visual Entailment with Natural Language Explanationscited by 8
- 2023Global Constraints with Prompting for Zero-Shot Event Argument Classificationcited by 8
Built on by
Citing papers per year: 2024: 3.
3 papers.
- 2024MIND: Multimodal Shopping Intention Distillation from Large Vision-language Models for E-commerce Purchase Understandingcited by 10
- 2024ComparisonQA: Evaluating Factuality Robustness of LLMs Through Knowledge Frequency Control and Uncertaintycited by 10
- 2024KNOWCOMP POKEMON Team at DialAM-2024: A Two-Stage Pipeline for Detecting Relations in Dialogical Argument Miningcited by 2
- 2024ComparisonQA: Evaluating Factuality Robustness of LLMs Through Knowledge Frequency Control and Uncertainty28 Dec 2024
- 2024KNOWCOMP POKEMON Team at DialAM-2024: A Two-Stage Pipeline for Detecting Relations in Dialogical Argument Mining29 Jul 2024
- 2024MIND: Multimodal Shopping Intention Distillation from Large Vision-language Models for E-commerce Purchase Understanding15 Jun 2024