Implementing Long Text Style Transfer with LLMs through Dual-Layered Sentence and Paragraph Structure Extraction and Mapping
Not on the map. Why?
Abstract (arXiv)
This paper addresses the challenge in long-text style transfer using zero-shot learning of large language models (LLMs), proposing a hierarchical framework that combines sentence-level stylistic adaptation with paragraph-level structural coherence. We argue that in the process of effective paragraph-style transfer, to preserve the consistency of original syntactic and semantic information, it is essential to perform style transfer not only at the sentence level but also to incorporate paragraph-level semantic considerations, while ensuring structural coherence across inter-sentential relationships. Our proposed framework, ZeroStylus, operates through two systematic phases: hierarchical template acquisition from reference texts and template-guided generation with multi-granular matching. The framework dynamically constructs sentence and paragraph template repositories, enabling context-aware transformations while preserving inter-sentence logical relationships. Experimental evaluations demonstrate significant improvements over baseline methods, with structured rewriting achieving 6.90 average score compared to 6.70 for direct prompting approaches in tri-axial metrics assessing style consistency, content preservation, and expression quality. Ablation studies validate the necessity of both template hierarchies during style transfer, showing higher content preservation win rate against sentence-only approaches through paragraph-level structural encoding, as well as direct prompting method through sentence-level pattern extraction and matching. The results establish new capabilities for coherent long-text style transfer without requiring parallel corpora or LLM fine-tuning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 33 references that are in the map. First posted on arXiv 11 May 2025.
Builds on
26 of 33 references.
References · 26
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
- 2024Understanding the planning of LLM agents: A surveycited by 421
- 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 248
- 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 211
- 2020Deep Learning for Text Style Transfer: A Surveycited by 162
- 2023T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by Stepcited by 93
- 2024Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuningcited by 90
- 2020A Probabilistic Formulation of Unsupervised Text Style Transfercited by 70
- 2024Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilitiescited by 69
14 more
- 2025PaSa: An LLM Agent for Comprehensive Academic Paper Searchcited by 64
- 2018Polite Dialogue Generation Without Parallel Datacited by 59
- 2020AxCell: Automatic Extraction of Results from Machine Learning Paperscited by 48
- 2025CoSER: A Comprehensive Literary Dataset and Framework for Training and Evaluating LLM Role-Playing and Persona Simulationcited by 26
- 2024Style-Specific Neurons for Steering LLMs in Text Style Transfercited by 24
- 2019Sentence-Level Content Planning and Style Specification for Neural Text Generationcited by 23
- 2019Adapting Language Models for Non-Parallel Author-Stylized Rewritingcited by 23
- 2024Distilling Text Style Transfer With Self-Explanation From LLMscited by 12
- 2024CAT-LLM: Style-enhanced Large Language Models with Text Style Definition for Chinese Article-style Transfercited by 10
- 2025DH-RAG: A Dynamic Historical Context-Powered Retrieval-Augmented Generation Method for Multi-Turn Dialoguecited by 10
- 2024Unsupervised Text Style Transfer via LLMs and Attention Masking with Multi-way Interactionscited by 7
- 2024Using Prompts to Guide Large Language Models in Imitating a Real Person's Language Stylecited by 6
- 2024LMStyle Benchmark: Evaluating Text Style Transfer for Chatbotscited by 5
- 2024Textualized Agent-Style Reasoning for Complex Tasks by Multiple Round LLM Generationcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.