SALSA: Attacking Lattice Cryptography with Transformers
Not on the map. Why?
Abstract (arXiv)
Currently deployed public-key cryptosystems will be vulnerable to attacks by full-scale quantum computers. Consequently, "quantum resistant" cryptosystems are in high demand, and lattice-based cryptosystems, based on a hard problem known as Learning With Errors (LWE), have emerged as strong contenders for standardization. In this work, we train transformers to perform modular arithmetic and combine half-trained models with statistical cryptanalysis techniques to propose SALSA: a machine learning attack on LWE-based cryptographic schemes. SALSA can fully recover secrets for small-to-mid size LWE instances with sparse binary secrets, and may scale to attack real-world LWE-based cryptosystems.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 26 of its 72 references that are in the map. First posted on arXiv 11 Jul 2022.
Builds on
26 of 72 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 599
- 2020Generative Language Modeling for Automated Theorem Provingcited by 379
- 2019Analysing Mathematical Reasoning Abilities of Neural Modelscited by 331
- 2019Deep Learning for Symbolic Mathematicscited by 266
- 2021Neural Symbolic Regression that Scalescited by 185
- 2021Investigating the Limitations of Transformers with Simple Arithmetic Taskscited by 136
- 2015Neural GPUs Learn Algorithmscited by 118
- 2017Failures of Gradient-Based Deep Learningcited by 79
- 2018Neural Arithmetic Logic Unitscited by 69
14 more
- 2021The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalizationcited by 62
- 2021Linear algebra with transformerscited by 62
- 2022Deep Symbolic Regression for Recurrent Sequencescited by 53
- 2021Symbolic Brittleness in Sequence Models: on Systematic Generalization in Symbolic Mathematicscited by 27
- 2013Classical Hardness of Learning with Errorscited by 11
- 2020Can Sequence-to-Sequence Models Crack Substitution Ciphers?cited by 9
- 2021Transformer-based Machine Learning for Fast SAT Solvers and Logic Synthesiscited by 8
- 2021Solving Arithmetic Word Problems with Transformers and Preprocessing of Problem Textcited by 7
- 2021A deep language model to predict metabolic network equilibriacited by 3
- 2015Provably weak instances of Ring-LWEcited by 2
- 2017Learning the Enigma with Recurrent Neural Networkscited by 2
- 2019Using fuzzy bits and neural networks to partially invert few rounds of some cryptographic hash functionscited by 2
- 2017Security considerations for Galois non-dual RLWE familiescited by 1
- 2017Attacks on the Search-RLWE problem with small errorscited by 1
Built on by
Citing papers per year: 2023: 6; 2024: 6; 2025: 13; 2026: 3.
28 papers.
Sort:
By area:
- 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 80
- 2023Length Generalization in Arithmetic Transformerscited by 64
- 2024Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformerscited by 29
- 2024Transforming the Bootstrap: Using Transformers to Compute Scattering Amplitudes in Planar N = 4 Super Yang-Mills Theorycited by 17
- 2023SALSA PICANTE: a machine learning attack on LWE with binary secretscited by 11
- 2023Learning to Compute Gr"obner Basescited by 7
- 2024Salsa Fresca: Angular Embeddings and Pre-Training for ML Attacks on Learning With Errorscited by 7
- 2025Computational Algebra with Attention: Transformer Oracles for Border Basis Algorithmscited by 7
- 2025Should LLM Safety Be More Than Refusing Harmful Instructions?cited by 6
- 2025Benchmarking Large Language Models for Cryptanalysis and Side-Channel Vulnerabilitiescited by 5
- 2024Making Hard Problems Easier with Custom Data Distributions and Loss Regularization: A Case Study in Modular Arithmeticcited by 4
- 2025Geometric Generality of Transformer-Based Gr"obner Basis Computationcited by 3
16 more
- 2023Gradient Descent Fails to Learn High-frequency Functions and Modular Arithmeticcited by 2
- 2024Machine learning for modular multiplicationcited by 2
- 2025Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Provingcited by 2
- 2025Discovering Learning-Friendly Generation Orders for Sequential Computationcited by 1
- 2023Practically Solving LPN in High Noise Regimes Faster Using Neural Networkscited by 0
- 2023Memorization for Good: Encryption with Autoregressive Language Modelscited by 0
- 2025Prime Convolutional Model: Breaking the Ground for Theoretical Explainabilitycited by 0
- 2025The informativeness of the gradient revisitedcited by 0
- 2025CALT: A Library for Computer Algebra with Transformercited by 0
- 2025Learning Moderately Input-Sensitive Functions: A Case Study in QR Code Decodingcited by 0
- 2025NoMod: A Non-modular Attack on Module Learning With Errorscited by 0
- 2025TAPAS: Datasets for Learning the Learning with Errors Problemcited by 0
- 2025Learning Pseudorandom Numbers with Transformers: Permuted Congruential Generators, Curricula, and Interpretabilitycited by 0
- 2026Improving ML Attacks on LWE with Data Repetition and Stepwise Regressioncited by 0
- 2026Discovering Lattice Reduction Strategies via Self-Playcited by 0
- 2026CARTS: Contextual Autoregressive Rank Transcoding Steganography for Full-Capacity Keyed Text Encodingcited by 0
- 2026CARTS: Contextual Autoregressive Rank Transcoding Steganography for Full-Capacity Keyed Text Encoding9 Sep 2026
- 2026Discovering Lattice Reduction Strategies via Self-Play13 Jun 2026
- 2026Improving ML Attacks on LWE with Data Repetition and Stepwise Regression5 Apr 2026
- 2025Learning Pseudorandom Numbers with Transformers: Permuted Congruential Generators, Curricula, and Interpretability30 Oct 2025
- 2025TAPAS: Datasets for Learning the Learning with Errors Problem9 Oct 2025
- 2025NoMod: A Non-modular Attack on Module Learning With Errors2 Oct 2025
- 2025Discovering Learning-Friendly Generation Orders for Sequential Computation30 Jun 2025
- 2025Learning Moderately Input-Sensitive Functions: A Case Study in QR Code Decoding25 Jun 2025
- 2025CALT: A Library for Computer Algebra with Transformer10 Jun 2025
- 2025Should LLM Safety Be More Than Refusing Harmful Instructions?3 Jun 2025
- 2025Benchmarking Large Language Models for Cryptanalysis and Side-Channel Vulnerabilities30 May 2025
- 2025Computational Algebra with Attention: Transformer Oracles for Border Basis Algorithms29 May 2025
16 more
- 2025The informativeness of the gradient revisited28 May 2025
- 2025Geometric Generality of Transformer-Based Gr"obner Basis Computation16 Apr 2025
- 2025Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Proving12 Mar 2025
- 2025Prime Convolutional Model: Breaking the Ground for Theoretical Explainability4 Mar 2025
- 2024Formal Mathematical Reasoning: A New Frontier in AI20 Dec 2024
- 2024Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformers10 Oct 2024
- 2024Making Hard Problems Easier with Custom Data Distributions and Loss Regularization: A Case Study in Modular Arithmetic4 Oct 2024
- 2024Transforming the Bootstrap: Using Transformers to Compute Scattering Amplitudes in Planar N = 4 Super Yang-Mills Theory9 May 2024
- 2024Machine learning for modular multiplication29 Feb 2024
- 2024Salsa Fresca: Angular Embeddings and Pre-Training for ML Attacks on Learning With Errors2 Feb 2024
- 2023Learning to Compute Gr"obner Bases21 Nov 2023
- 2023Gradient Descent Fails to Learn High-frequency Functions and Modular Arithmetic19 Oct 2023
- 2023Length Generalization in Arithmetic Transformers27 Jun 2023
- 2023Memorization for Good: Encryption with Autoregressive Language Models15 May 2023
- 2023Practically Solving LPN in High Noise Regimes Faster Using Neural Networks14 Mar 2023
- 2023SALSA PICANTE: a machine learning attack on LWE with binary secrets7 Mar 2023
- 2023Length Generalization in Arithmetic Transformerscited by 64
- 2024Transforming the Bootstrap: Using Transformers to Compute Scattering Amplitudes in Planar N = 4 Super Yang-Mills Theorycited by 17
- 2023SALSA PICANTE: a machine learning attack on LWE with binary secretscited by 11
- 2023Learning to Compute Gr"obner Basescited by 7
- 2024Salsa Fresca: Angular Embeddings and Pre-Training for ML Attacks on Learning With Errorscited by 7
- 2025Computational Algebra with Attention: Transformer Oracles for Border Basis Algorithmscited by 7
- 2025Benchmarking Large Language Models for Cryptanalysis and Side-Channel Vulnerabilitiescited by 5
- 2024Making Hard Problems Easier with Custom Data Distributions and Loss Regularization: A Case Study in Modular Arithmeticcited by 4
- 2025Geometric Generality of Transformer-Based Gr"obner Basis Computationcited by 3
- 2023Gradient Descent Fails to Learn High-frequency Functions and Modular Arithmeticcited by 2
- 2024Machine learning for modular multiplicationcited by 2
- 2025Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Provingcited by 2
12 most cited of 25 All 25 (JSON)
- 2026CARTS: Contextual Autoregressive Rank Transcoding Steganography for Full-Capacity Keyed Text Encoding9 Sep 2026
- 2026Discovering Lattice Reduction Strategies via Self-Play13 Jun 2026
- 2026Improving ML Attacks on LWE with Data Repetition and Stepwise Regression5 Apr 2026
- 2025Learning Pseudorandom Numbers with Transformers: Permuted Congruential Generators, Curricula, and Interpretability30 Oct 2025
- 2025TAPAS: Datasets for Learning the Learning with Errors Problem9 Oct 2025
- 2025NoMod: A Non-modular Attack on Module Learning With Errors2 Oct 2025
- 2025Discovering Learning-Friendly Generation Orders for Sequential Computation30 Jun 2025
- 2025Learning Moderately Input-Sensitive Functions: A Case Study in QR Code Decoding25 Jun 2025
- 2025CALT: A Library for Computer Algebra with Transformer10 Jun 2025
- 2025Benchmarking Large Language Models for Cryptanalysis and Side-Channel Vulnerabilities30 May 2025
- 2025Computational Algebra with Attention: Transformer Oracles for Border Basis Algorithms29 May 2025
- 2025The informativeness of the gradient revisited28 May 2025
12 newest of 25 All 25 (JSON)