计算机科学
模棱两可
构造(python库)
任务(项目管理)
人工智能
自然语言处理
特征(语言学)
机器学习
模式识别(心理学)
语言学
哲学
管理
经济
程序设计语言
作者
Yi Zhu,Ye Wang,Jianyuan Mu,Yun Li,Jipeng Qiang,Yunhao Yuan,Xindong Wu
标识
DOI:10.1016/j.eswa.2024.123248
摘要
Over the past few decades, short text classification has emerged as a critical downstream task in natural language processing (NLP). One crucial classification research issue is how to advance semantic understanding considering the short length, feature sparsity, and high ambiguity in short texts. Recently, prompt-tuning has been proposed to insert a template into the input and convert text classification tasks into equivalent cloze-style tasks. However, among most of the previous approaches, either the crafted template methods are time-consuming and labor-intensive, or automatic prompt generation methods cannot achieve satisfied performance. In this paper, we introduce a novel approach called Soft Knowledgeable Prompt-tuning for short text classification. Our method considers both the template generation and classification performance to construct prompts for label prediction. We employ five different strategies to expand the label words space for modifying soft prompts, and the integration of these strategies is used as the final verbalizer. Despite being automatic, experimental results show that our method achieved more desirable performance even than the crafted template methods, outperforming the state-of-the-art by more than 14 Accuracy points on four well-known benchmarks.
科研通智能强力驱动
Strongly Powered by AbleSci AI