Functorial Language Models
Not on the map. Why?
Abstract (arXiv)
We introduce functorial language models: a principled way to compute probability distributions over word sequences given a monoidal functor from grammar to meaning. This yields a method for training categorical compositional distributional (DisCoCat) models on raw text data. We provide a proof-of-concept implementation in DisCoPy, the Python toolbox for monoidal categories.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 13 of its 35 references that are in the map. First posted on arXiv 26 Mar 2021.
Builds on
13 of 35 references.
References · 13
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Foundations for Near-Term Quantum Natural Language Processingcited by 51
- 2020Quantum Natural Language Processing on Near-Term Quantum Computerscited by 39
- 2015Open System Categorical Quantum Semantics in Natural Language Processingcited by 17
- 2013Lambek vs. Lambek: Functorial Vector Space Semantics and String Diagrams for Lambek Calculuscited by 13
- 2015Sentence Entailment in Compositional Distributional Semanticscited by 9
- 2014Reasoning about Meaning in Natural Language with Compact Closed Categories and Frobenius Algebrascited by 7
- 2021Diagrammatic Differentiation for Quantum Machine Learningcited by 5
- 2018Towards Compositional Distributional Discourse Analysiscited by 4
- 2019Functorial Question Answeringcited by 4
- 2014Autonomization of Monoidal Categoriescited by 3
- 2018Exploring Semantic Incrementality with Dynamic Syntax and Vector Space Semanticscited by 2
1 more
- 2020Incremental Monoidal Grammarscited by 2
Built on by
Citing papers per year: 2024: 1.
1 paper.