# Neural Academic Paper Generation

arXiv: https://arxiv.org/abs/1912.01982 · HTML: https://mlsanity.com/paper/1912.01982/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Dec 2019.

## Built on by (most cited first, 1 of 1)

- [SciXGen: A Scientific Paper Dataset for Context-Aware Text Generation](https://mlsanity.com/paper/2110.10774/) (2021)

## Abstract (arXiv)

In this work, we tackle the problem of structured text generation, specifically academic paper generation in LaTeX, inspired by the surprisingly good results of basic character-level language models. Our motivation is using more recent and advanced methods of language modeling on a more complex dataset of LaTeX source files to generate realistic academic papers. Our first contribution is preparing a dataset with LaTeX source files on recent open-source computer vision papers. Our second contribution is experimenting with recent methods of language modeling and text generation such as Transformer and Transformer-XL to generate consistent LaTeX code. We report cross-entropy and bits-per-character (BPC) results of the trained models, and we also discuss interesting points on some examples of the generated LaTeX code.