Can Constructions "SCAN" Compositionality ?
Not on the map. Why?
Abstract (arXiv)
Sequence to Sequence models struggle at compositionality and systematic generalisation even while they excel at many other tasks. We attribute this limitation to their failure to internalise constructions conventionalised form meaning pairings that license productive recombination. Building on these insights, we introduce an unsupervised procedure for mining pseudo-constructions: variable-slot templates automatically extracted from training data. When applied to the SCAN dataset, our method yields large gains out-of-distribution splits: accuracy rises to 47.8 %on ADD JUMP and to 20.3% on AROUND RIGHT without any architectural changes or additional supervision. The model also attains competitive performance with? 40% of the original training data, demonstrating strong data efAciency. Our findings highlight the promise of construction-aware preprocessing as an alternative to heavy architectural or training-regime interventions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 41 references that are in the map. First posted on arXiv 24 Sep 2025.
Builds on
15 of 41 references.
References · 15
- 2017Attention Is All You Needcited by 60,361
- 2015Neural Module Networkscited by 376
- 2019Measuring Compositional Generalization: A Comprehensive Method on Realistic Datacited by 284
- 2019Compositionality decomposed: how do neural networks generalise?cited by 265
- 2020COGS: A Compositional Generalization Challenge Based on Semantic Interpretationcited by 263
- 2018Compositional Attention Networks for Machine Reasoningcited by 183
- 2019CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from Textcited by 162
- 2019Good-Enough Compositional Data Augmentationcited by 158
- 2019Neural Logic Machinescited by 145
- 2019Compositional generalization through meta sequence-to-sequence learningcited by 99
- 2021Unlocking Compositional Generalization in Pre-trained Models Using Intermediate Representationscited by 55
- 2018Rearranging the Familiar: Testing Compositional Generalization in Recurrent Networkscited by 51
3 more
- 2018Memorize or generalize? Searching for a compositional RNN in a haystackcited by 41
- 2019Joey NMT: A Minimalist NMT Toolkit for Novicescited by 39
- 2020CxGBERT: BERT meets Construction Grammarcited by 32
Built on by
Not cited yet.