Complexity-based partitioning of CSFI problem instances with Transformers
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a two-steps approach to partition instances of the Conjunctive Normal Form (CNF) Syntactic Formula Isomorphism problem (CSFI) into groups of different complexity. First, we build a model, based on the Transformer architecture, that attempts to solve instances of the CSFI problem. Then, we leverage the errors of such model and train a second Transformer-based model to partition the problem instances into groups of different complexity, thus detecting the ones that can be solved without using too expensive resources. We evaluate the proposed approach on a pseudo-randomly generated dataset and obtain promising results. Finally, we discuss the possibility of extending this approach to other problems based on the same type of textual representation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 23 references that are in the map. First posted on arXiv 28 Jun 2021.
Builds on
13 of 23 references.
References · 13
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2018Image Transformercited by 770
- 2018Learning a SAT Solver from Single-Bit Supervisioncited by 198
- 2018Learning to Solve NP-Complete Problems - A Graph Neural Network for Decision TSPcited by 58
- 2020What does BERT know about books, movies and music? Probing BERT for Conversational Recommendationcited by 36
1 more
- 2015Graph Isomorphism in Quasipolynomial Timecited by 19
Built on by
Not cited yet.