Applying language models to algebraic topology: generating simplicial cycles using multi-labeling in Wu's formula
Not on the map. Why?
Abstract (arXiv)
Computing homotopy groups of spheres has long been a fundamental objective in algebraic topology. Various theoretical and algorithmic approaches have been developed to tackle this problem. In this paper we take a step towards the goal of comprehending the group-theoretic structure of the generators of these homotopy groups by leveraging the power of machine learning. Specifically, in the simplicial group setting of Wu's formula, we reformulate the problem of generating simplicial cycles as a problem of sampling from the intersection of algorithmic datasets related to Dyck languages. We present and evaluate language modelling approaches that employ multi-label information for input sequences, along with the necessary group-theoretic toolkit and non-neural baselines.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 69 references that are in the map. First posted on arXiv 1 Jun 2023.
Builds on
25 of 69 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
- 2016SeqGAN: Sequence Generative Adversarial Nets with Policy Gradientcited by 375
- 2019Theoretical Limitations of Self-Attention in Neural Sequence Modelscited by 286
- 2020Evaluation of Text Generation: A Surveycited by 275
- 2019Deep Learning for Symbolic Mathematicscited by 266
- 2021Thinking Like Transformerscited by 182
13 more
- 2022Formal Mathematics Statement Curriculum Learningcited by 141
- 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 130
- 2020A Survey on Generative Adversarial Networks: Variants, Applications, and Trainingcited by 97
- 2021Pretrained Language Models for Text Generation: A Surveycited by 95
- 2019Understanding Neural Networks via Feature Visualization: A surveycited by 65
- 2020How Can Self-Attention Networks Recognize Dyck-n Languages?cited by 51
- 2021Constructions in combinatorics via neural networkscited by 46
- 2017Generating and designing DNA with deep generative modelscited by 30
- 2021Machine-Learning Mathematical Structurescited by 25
- 2020Learning selection strategies in Buchberger's algorithmcited by 20
- 2020Fast differentiable DNA and protein sequence optimization for molecular designcited by 10
- 2017Computing simplicial representatives of homotopy group elementscited by 1
- 2019IntersectGAN: Learning Domain Intersection for Generating Images with Multiple Attributescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.