mlsanityData to 7 Oct 2026

Syntax-Guided Diffusion Language Models with User-Integrated Personalization

arXiv 2510.01028 ↗First posted 1 Oct 2025cs.CL stat.MEcited by 0

On the map: Diffusion models → Discrete and text diffusion

Abstract (arXiv)

Large language models have made revolutionary progress in generating human-like text, yet their outputs often tend to be generic, exhibiting insufficient structural diversity, which limits personalized expression. Recent advances in diffusion models have opened new opportunities for improving language generation beyond the limitations of autoregressive paradigms. In this work, we propose a syntax-guided diffusion language model that integrates structural supervision and personalized conditioning to enhance text quality, diversity, and controllability. We introduce a cascaded framework that generates syntactic guidance before conditional text generation, and further generalize it to a novel noncascaded architecture for better alignment between structure and content. By incorporating syntactic information in the generating process, the proposed model better captures the lexical and structural characteristics of stylistic sentence construction. To enable fine-grained personalization, we develop a shared representation mechanism that facilitates information integration across users, supporting both faithful stylistic generation and generalizable zero-shot inference. Extensive experiments on multiple tasks demonstrate the superiority of our approach in fluency, diversity, and stylistic fidelity. Further qualitative analyses highlight its interpretability and flexibility in learning personalized patterns.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 44 of its 57 references that are in the map. First posted on arXiv 1 Oct 2025.

Builds on

44 of 57 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Discrete Diffusion in Large Language and Multimodal Models: A Survey16 Jun
  2. 2025Anchored Diffusion Language Model24 May
  3. 2025Large Language Diffusion Models14 Feb
  4. 2024Simplified and Generalized Masked Diffusion for Discrete Data6 Jun
  5. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution25 Oct
  6. 2023Diffusion Models for Non-autoregressive Text Generation: A Survey12 Mar
  7. 2022Latent Diffusion for Language Generation19 Dec
  8. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models17 Oct

Other references · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  8. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  9. 2024GPT-4o System Cardcited by 4,467
  10. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  11. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  12. 2019The Curious Case of Neural Text Degenerationcited by 2,881
24 more
  1. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  2. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  3. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  4. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
  5. 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
  6. 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 466
  7. 2023LaMP: When Large Language Models Meet Personalizationcited by 425
  8. 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 365
  9. 2022Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioningcited by 362
  10. 2025Mercury: Ultra-Fast Language Models Based on Diffusioncited by 225
  11. 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 196
  12. 2024Implicit Style-Content Separation using B-LoRAcited by 135
  13. 2018Inferring Semantic Layout for Hierarchical Text-to-Image Synthesiscited by 101
  14. 2019Generating Sentences from Disentangled Syntactic and Semantic Spacescited by 59
  15. 2021UserIdentifier: Implicit User Representations for Simple and Effective Personalized Sentiment Analysiscited by 28
  16. 2025The Shrinking Landscape of Linguistic Diversity in the Age of Large Language Modelscited by 28
  17. 2024Personalized Text Generation with Fine-Grained Linguistic Controlcited by 20
  18. 2023Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networkscited by 15
  19. 2020Escaping the curse of dimensionality in Bayesian model based clusteringcited by 12
  20. 2023Explicit Syntactic Guidance for Neural Text Generationcited by 8
  21. 2019Representation Learning: A Statistical Perspectivecited by 7
  22. 2016An Architecture for Deep, Hierarchical Generative Modelscited by 6
  23. 2025Representation Retrieval Learning for Heterogeneous Data Integrationcited by 5
  24. 2025Multi-task Learning for Heterogeneous Multi-source Block-Wise Missing Datacited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Steering Guidance for Personalized Text-to-Image Diffusion Models
  2. 2026Time-Annealed Perturbation Sampling: Diverse Generation for Diffusion Language Models
  3. 2024Language Rectified Flow: Advancing Diffusion Language Generation with Probabilistic Flows
  4. 2022Self-conditioned Embedding Diffusion for Text Generation
  5. 2025Controllable Stylistic Text Generation with Train-Time Attribute-Regularized Diffusion
  6. 2025Personalized Text Generation with Contrastive Activation Steering
  7. 2024Diffusion Guided Language Modeling
  8. 2023Fine-grained Text Style Transfer with Diffusion-Based Language Models