ShortListing Model: A Streamlined SimplexDiffusion for Discrete Variable Generation
Not on the map. Why?
Abstract (arXiv)
Generative modeling of discrete variables is challenging yet crucial for applications in natural language processing and biological sequence design. We introduce the Shortlisting Model (SLM), a novel simplex-based diffusion model inspired by progressive candidate pruning. SLM operates on simplex centroids, reducing generation complexity and enhancing scalability. Additionally, SLM incorporates a flexible implementation of classifier-free guidance, enhancing unconditional generation performance. Extensive experiments on DNA promoter and enhancer design, protein design, character-level and large-vocabulary language modeling demonstrate the competitive performance and strong potential of SLM. Our code can be found at https://github.com/GenSI-THUAIR/SLM
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 29 of its 64 references that are in the map. First posted on arXiv 24 Aug 2025.
Builds on
29 of 64 references.
References · 29
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023GPT-4 Technical Reportcited by 18,396
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2024Simple and Effective Masked Diffusion Language Modelscited by 848
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 574
- 2022DiGress: Discrete Denoising diffusion for graph generationcited by 520
17 more
- 2022Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioningcited by 373
- 2024Discrete Flow Matchingcited by 317
- 2021Autoregressive Diffusion Modelscited by 210
- 2024Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Samplingcited by 208
- 2022ProGen2: Exploring the Boundaries of Protein Language Modelscited by 159
- 2024Simple Guidance Mechanisms for Discrete Diffusion Modelscited by 155
- 2023Likelihood-Based Diffusion Language Modelscited by 151
- 2024Dirichlet Flow Matching with Applications to DNA Sequence Designcited by 115
- 2024Diffusion Language Models Are Versatile Protein Learnerscited by 98
- 2024Energy-Based Diffusion Language Models for Text Generationcited by 89
- 2023Dirichlet Diffusion Score Model for Biological Sequence Generationcited by 75
- 2024Fisher Flow Matching for Generative Modeling over Discrete Datacited by 72
- 2019Discrete Flows: Invertible Generative Models of Discrete Datacited by 68
- 2013Projection onto the probability simplex: An efficient algorithm with a simple proof, and an applicationcited by 67
- 2022Training and Inference on Any-Order Autoregressive Models the Right Waycited by 64
- 2023Bayesian Flow Networkscited by 63
- 2024Categorical Flow Matching on Statistical Manifoldscited by 47
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024DiscDiff: Latent Diffusion Model for DNA Sequence Generation
- 2024Diffusion on language model encodings for protein sequence generation
- 2025HAD: Hybrid Architecture Distillation Outperforms Teacher in Genomic Sequence Modeling
- 2025JanusDNA: A Powerful Bi-directional Hybrid DNA Foundation Model
- 2024Latent Diffusion Models for Controllable RNA Sequence Generation
- 2024Bio-xLSTM: Generative modeling, representation and in-context learning of biological and chemical sequences
- 2025A Unification of Discrete, Gaussian, and Simplicial Diffusion
- 2026D3LM: A Discrete DNA Diffusion Language Model for Bidirectional DNA Understanding and Generation