On the Statistical Query Complexity of Learning Semiautomata: a Random Walk Approach
Not on the map. Why?
Abstract (arXiv)
Semiautomata form a rich class of sequence-processing algorithms with applications in natural language processing, robotics, computational biology, and data mining. We establish the first Statistical Query hardness result for semiautomata under the uniform distribution over input words and initial states. We show that Statistical Query hardness can be established when both the alphabet size and input length are polynomial in the number of states. Unlike the case of deterministic finite automata, where hardness typically arises through the hardness of the language they recognize (e.g., parity), our result is derived solely from the internal state-transition structure of semiautomata. Our analysis reduces the task of distinguishing the final states of two semiautomata to studying the behavior of a random walk on the group SN × SN. By applying tools from Fourier analysis and the representation theory of the symmetric group, we obtain tight spectral gap bounds, demonstrating that after a polynomial number of steps in the number of states, distinct semiautomata become nearly uncorrelated, yielding the desired hardness result.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 12 of its 65 references that are in the map. First posted on arXiv 5 Oct 2025.
Builds on
12 of 65 references.
References · 12
- 2015An Introduction to Matrix Concentration Inequalitiescited by 397
- 2022Transformers Learn Shortcuts to Automatacited by 268
- 2016Statistical Query Lower Bounds for Robust Estimation of High-dimensional Gaussians and Gaussian Mixturescited by 115
- 2017Extracting Automata from Recurrent Neural Networks Using Queries and Counterexamplescited by 66
- 2020Superpolynomial Lower Bounds for Learning One-Layer Neural Networks using Gradient Descentcited by 58
- 2020Near-Optimal SQ Lower Bounds for Agnostically Learning Halfspaces and ReLUs under Gaussian Marginalscited by 57
- 2025Learning Compositional Functions with Transformers from Easy-to-Hard Datacited by 36
- 2018A survey on policy search algorithms for learning robot controllers in a handful of trialscited by 35
- 2021On the Power of Differentiable Learning versus PAC and SQ Learningcited by 28
- 2022Near-Optimal Statistical Query Lower Bounds for Agnostically Learning Intersections of Halfspaces with Gaussian Marginalscited by 6
- 2024L^*LM: Learning Automata from Examples using Natural Language Oraclescited by 2
- 2023Learning Deterministic Finite Automata from Confidence Oraclescited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026What Pretraining and Midtraining Make Learnable from Rewards?29 Sep 2026
- 2026Learning to Reason with Curriculum II: Compositional Generalization26 Jun 2026
- 2026Learning to Reason with Curriculum I: Provable Benefits of Autocurriculum18 Mar 2026
- 2025LLM Priors for ERM over Programs16 Oct 2025