Zero-shot Cross-Linguistic Learning of Event Semantics
Not on the map. Why?
Abstract (arXiv)
Typologically diverse languages offer systems of lexical and grammatical aspect that allow speakers to focus on facets of event structure in ways that comport with the specific communicative setting and discourse constraints they face. In this paper, we look specifically at captions of images across Arabic, Chinese, Farsi, German, Russian, and Turkish and describe a computational model for predicting lexical aspects. Despite the heterogeneity of these languages, and the salient invocation of distinctive linguistic resources across their caption corpora, speakers of these languages show surprising similarities in the ways they frame image content. We leverage this observation for zero-shot cross-lingual learning and show that lexical aspects can be predicted for a given language despite not having observed any annotated data for this language at all.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 60 references that are in the map. First posted on arXiv 5 Jul 2022.
Builds on
14 of 60 references.
References · 14
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018Deep contextualized word representationscited by 2,290
- 2014Show and Tell: A Neural Image Caption Generatorcited by 879
- 2018Learning Word Vectors for 157 Languagescited by 280
- 2016Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measurescited by 36
- 2015Morphological Analyzer and Generator for Russian and Ukrainian Languagescited by 25
- 2020Clue: Cross-modal Coherence Modeling for Caption Generationcited by 24
- 2018Towards Better UD Parsing: Deep Contextualized Word Embeddings, Ensemble, and Treebank Concatenationcited by 21
- 2019CITE: A Corpus of Image-Text Discourse Relationscited by 12
- 2019Temporal and Aspectual Entailmentcited by 7
- 2021Incorporating Temporal Information in Entailment Graph Miningcited by 7
2 more
- 2015Image Specificitycited by 4
- 2020Aspectuality Across Genre: A Distributional Semantics Approachcited by 4
Built on by
Not cited yet.