mlsanityData to 7 Oct 2026

Text-Conditioned Background Generation for Editable Multi-Layer Documents

arXiv 2512.17151 ↗First posted 19 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a framework for document-centric background generation with multi-page editing and thematic continuity. To ensure text regions remain readable, we employ a latent masking formulation that softly attenuates updates in the diffusion space, inspired by smooth barrier functions in physics and numerical optimization. In addition, we introduce Automated Readability Optimization (ARO), which automatically places semi-transparent, rounded backing shapes behind text regions. ARO determines the minimal opacity needed to satisfy perceptual contrast standards (WCAG 2.2) relative to the underlying background, ensuring readability while maintaining aesthetic harmony without human intervention. Multi-page consistency is maintained through a summarization-and-instruction process, where each page is distilled into a compact representation that recursively guides subsequent generations. This design reflects how humans build continuity by retaining prior context, ensuring that visual motifs evolve coherently across an entire document. Our method further treats a document as a structured composition in which text, figures, and backgrounds are preserved or regenerated as separate layers, allowing targeted background editing without compromising readability. Finally, user-provided prompts allow stylistic adjustments in color and texture, balancing automated consistency with flexible customization. Our training-free framework produces visually coherent, text-preserving, and thematically aligned documents, bridging generative modeling with natural design workflows.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 48 references that are in the map. First posted on arXiv 19 Dec 2025.

Builds on

39 of 48 references.

References · 39

  1. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  2. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  3. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  4. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  5. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  6. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  7. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  8. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
  9. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  10. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
  11. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
  12. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 280
27 more
  1. 2016Control Barrier Function Based Quadratic Programs for Safety Critical Systemscited by 261
  2. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
  3. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
  4. 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
  5. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  6. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
  7. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
  8. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
  9. 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 94
  10. 2022Enforcing Hard Constraints with Soft Barriers: Safe Reinforcement Learning in Unknown Stochastic Environmentscited by 54
  11. 2023LayerDiffusion: Layered Controlled Image Editing with Diffusion Modelscited by 40
  12. 2024HiCo: Hierarchical Controllable Diffusion Model for Layout-to-image Generationcited by 39
  13. 2025DesignDiffusion: High-Quality Text-to-Design Image Generation with Diffusion Modelscited by 37
  14. 2023Relation-Aware Diffusion Model for Controllable Poster Layout Generationcited by 36
  15. 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 36
  16. 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
  17. 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26
  18. 2024Desigen: A Pipeline for Controllable Design Template Generationcited by 19
  19. 2024LayerFusion: Harmonized Multi-Layer Text-to-Image Generation with Generative Priorscited by 19
  20. 2025CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generationcited by 17
  21. 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Modelscited by 15
  22. 2024Spatial-Aware Latent Initialization for Controllable Image Generationcited by 15
  23. 2024Salient Object-Aware Background Generation using Text-Guided Diffusion Modelscited by 5
  24. 2023Soft-Minimum Barrier Functions for Safety-Critical Control Subject to Actuation Constraintscited by 3
  25. 2021Multiple GAN Inversion for Exemplar-based Image-to-Image Translationcited by 2
  26. 2021FBC-GAN: Diverse and Flexible Image Synthesis via Foreground-Background Compositioncited by 2
  27. 2025Character-Centered Dialogue Generation from Scene-Level Promptscited by 2

Built on by

Not cited yet.