Structural Generalization on SLOG without Hand-Written Rules
Not on the map. Why?
Abstract (arXiv)
Structural generalization in semantic parsing requires systems to apply learned compositional rules to novel structural combinations. Existing approaches either rely on hand-written algebraic rules (AM-Parser) or fail to generalize structurally (Transformer-based models). We present an alternative requiring no hand-written compositional rules, based on a neural cellular automaton (NCA) with a discrete bottleneck: all compositional rules are learned from data through local iteration. On the SLOG benchmark, the system achieves an overall accuracy of 67.3 ± 0.2% across 10 seeds (AM-Parser: 70.8 ± 4.3%), with 11 of 17 structural generalization categories at 100% type-exact match, including three where AM-Parser scores 0--74%. Analysis reveals that all 5,539 failure instances reduce to exactly two mechanisms: novel combinations of wh-extraction context with reduced verb types, and modifiers appearing on the subject side of verbs. When we decompose results by CCG structural features, each sub-pattern either succeeds on all instances or fails on all. Intermediate scores (e.g., 41.4%) are mixtures of structurally distinct CCG patterns, not partial generalization. These results suggest that CCG directed types provide higher resolution than SLOG's phenomenon-level categories for characterizing structural generalization, and that the success/failure boundary is determined by the coverage of directed operations in the training data.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 21 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
14 of 21 references.
References · 14
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2020COGS: A Compositional Generalization Challenge Based on Semantic Interpretationcited by 263
- 2022Structural generalization is hard for sequence-to-sequence modelscited by 24
- 2023ReCOGS: How Incidental Details of a Logical Form Overshadow an Evaluation of Semantic Interpretationcited by 24
- 2023SLOG: A Structural Generalization Benchmark for Semantic Parsingcited by 22
- 2018AMR Dependency Parsing with a Typed Semantic Algebracited by 17
- 2019Compositional Semantic Parsing Across Graphbankscited by 15
- 2023Structural generalization in COGS: Supertagging is (almost) all you needcited by 4
2 more
Built on by
Not cited yet.