mlsanityData to 7 Oct 2026

The Free Transformer

arXiv 2510.17558 ↗First posted 20 Oct 2025cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

We propose an extension of the decoder Transformer that conditions its generative process on random latent variables which are learned without supervision thanks to a variational procedure. Experimental evaluations show that allowing such a conditioning translates into substantial improvements on downstream tasks.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 27 references that are in the map. First posted on arXiv 20 Oct 2025.

Builds on

19 of 27 references.

References · 19

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  5. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  7. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  8. 2021Program Synthesis with Large Language Modelscited by 3,509
  9. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
  10. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
  11. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
  12. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
7 more
  1. 2020GLU Variants Improve Transformercited by 1,724
  2. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  3. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,311
  4. 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
  5. 2020Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Spacecited by 114
  6. 2021Transformer-based Conditional Variational Autoencoder for Controllable Story Generationcited by 44
  7. 2021Exploring Story Generation with Multi-task Objectives in Variational Autoencoderscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

  1. 2026Solve the Loop: Attractor Models for Language and Reasoningcited by 11
  2. 2026Safe Transformer: An Explicit Safety Bit For Interpretable And Controllable Alignmentcited by 0