Structured Prompt Optimization for Few-Shot Text Classification via Semantic Alignment in Latent Space
Not on the map. Why?
Abstract (arXiv)
This study addresses the issues of semantic entanglement, unclear label structure, and insufficient feature representation in few-shot text classification, and proposes an optimization framework based on structured prompts to enhance semantic understanding and task adaptation under low-resource conditions. The framework first uses a pretrained language model to encode the input text and obtain basic semantic representations. It then introduces structured prompts composed of multi-dimensional semantic factors and integrates them with text features through a learnable combination mechanism, which forms task-related representations with clear boundaries in the latent space. To further strengthen the consistency between text representations and label semantics, the method constructs a structured label embedding matrix and employs a cross-space alignment mechanism to ensure stable matching between textual features and label attributes. In addition, the model applies prompt orthogonality constraints and a joint optimization objective to maintain independence across different semantic factors in the prompts, allowing the structured prompts to provide transparent and controllable guidance for classification decisions. Three types of sensitivity experiments, including learning rate sensitivity, prompt length sensitivity, and data scale sensitivity, are designed to evaluate the stability and robustness of the framework under different conditions. Experimental results show that the proposed structured prompt optimization framework effectively alleviates semantic conflicts and label ambiguity in few-shot text classification. It significantly improves performance on accuracy, precision, recall, and AUC, and demonstrates strong cross-task applicability.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 24 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
10 of 24 references.
References · 10
- 2021NSP-BERT: A Prompt-based Few-Shot Learner Through an Original Pre-training Task--Next Sentence Predictioncited by 23
- 2022Towards Unified Prompt Tuning for Few-shot Text Classificationcited by 18
- 2025Trustworthy Summarization via Uncertainty Quantification and Risk Awareness in Large Language Modelscited by 10
- 2025Dynamic Prompt Fusion for Multi-Task and Cross-Domain Adaptation in LLMscited by 9
- 2022TextConvoNet:A Convolutional Neural Network based Architecture for Text Classificationcited by 5
- 2025Parameter-Efficient Fine-Tuning with Differential Privacy for Robust Instruction Adaptation in Large Language Modelscited by 5
- 2025Knowledge-Augmented Large Language Model Agents for Explainable Financial Decision-Makingcited by 3
- 2025Structure-Aware Decoding Mechanisms for Complex Entity Extraction with Large-Scale Language Modelscited by 3
- 2025Predictive-LoRA: A Proactive and Fragmentation-Aware Serverless Inference System for LLMscited by 2
- 2023Enhancing Black-Box Few-Shot Text Classification with Prompt-Based Data Augmentationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
- 2024Advancing Textual Prompt Learning with Anchored Attributes
- 2021Learning to Prompt for Vision-Language Models
- 2023Prompt Space Optimizing Few-shot Reasoning Success with Large Language Models
- 2026Joint Semantic Token Selection and Prompt Optimization for Interpretable Prompt Learning
- 2026Low-Rank Prompt Learning for Vision-Language Models with Fixed-Token Bases
- 2024Tuning Vision-Language Models with Candidate Labels by Prompt Alignment
- 2025Learning Generalizable Prompt for CLIP with Class Similarity Knowledge