mlsanityData to 14 Oct 2026

Pretrain on Small Synthetic Data, Scale Large for Free: Symmetry-Aware Foundation Model for Logic Rule Induction

arXiv 2608.00383 ↗First posted 1 Aug 2026cs.LO cs.AI cs.LGcited by 0

On the map: Synthetic data and self-improvement for LLMs → Synthetic reasoning data and bootstrapping

Abstract (arXiv)

Logical rule induction seeks interpretable rules that transfer across propositional schemas. This requires respecting symmetries: atom naming, example order, polarity flips, and label swap. Enforcing exact symmetry by construction lets one trained inducer scale beyond its training schemas. Our central contribution is a canonical export that decodes a discrete rule from literal scores. It needs no retraining and is exactly equivariant whenever those scores respect the symmetries. We instantiate it on the Neural Rule Inducer, a disjunctive-normal-form (DNF) foundation model that natively respects only example order. We restore the remaining symmetries through architecture, inference, and training. On synthetic stress tests, accuracy on the support labels stays stable at much larger schemas, and rule fidelity on fresh inputs remains above the unmodified model. On real data, accuracy improves most on larger schemas. The exported rule is exact on synthetic full-group tests and on schema-valid real-data tests. This is a mathematical property of the export rather than of a specific model, and we validate it empirically only on the NRI. Enforcing symmetry by construction turns this small-data pretrained model into a reusable, interpretable inducer that transfers to larger schemas.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Synthetic reasoning data and bootstrapping, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 20 of its 36 references that are in the map. First posted on arXiv 1 Aug 2026.

Builds on

20 of 36 references.

References · 20

  1. 2017Deep Setscited by 1,421
  2. 2016Group Equivariant Convolutional Networkscited by 1,165
  3. 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 715
  4. 2019Neural Probabilistic Logic Programming in DeepProbLogcited by 394
  5. 2018Invariant and Equivariant Graph Networkscited by 346
  6. 2020Neurosymbolic AI: The 3rd Wavecited by 255
  7. 2017Learning Explanatory Rules from Noisy Datacited by 211
  8. 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 179
  9. 2021Frame Averaging for Invariant and Equivariant Network Designcited by 168
  10. 2015Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction modelcited by 140
  11. 2020Better Aggregation in Test-Time Augmentationcited by 122
  12. 2022Equivariance with Learned Canonicalization Functionscited by 109
8 more
  1. 2020Right for the Right Concept: Revising Neuro-Symbolic Concepts by Interacting with their Explanationscited by 94
  2. 2020Learning programs by learning from failurescited by 73
  3. 2018Deep Models of Interactions Across Setscited by 69
  4. 2020From Statistical Relational to Neuro-Symbolic Artificial Intelligencecited by 63
  5. 2021FF-NSL: Feed-Forward Neural-Symbolic Learnercited by 15
  6. 2024Variable Assignment Invariant Neural Networks for Learning Logic Programscited by 4
  7. 2023Densely Connected G-invariant Deep Neural Networks with Signed Permutation Representationscited by 2
  8. 2026A Foundation Model for Zero-Shot Logical Rule Inductioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Patterns Over Principles: The Fragility of Inductive Reasoning in LLMs under Noisy Observations
  2. 2026CircuitSynth: Reliable Synthetic Data Generation
  3. 2026Hypothesis Frontier: Verifier Guided LLM and Symbolic Search for First-Order Induction
  4. 2026ORACLE: Optimizing Reasoning Abilities of Large Language Models via Constraint-Led Synthetic Data Elicitation
  5. 2026Think Through a Bottleneck: Hourglass Reasoning for Rigorous Induction
  6. 2025Conflict-Aware Fusion: Mitigating Logic Inertia in Large Language Models via Structured Cognitive Priors
  7. 2025Can Large Language Models Learn Formal Logic? A Data-Driven Training and Evaluation Framework
  8. 2026Distilling Formal Logic into Neural Spaces: A Kernel Alignment Approach for Signal Temporal Logic