聚类分析
计算机科学
过度拟合
水准点(测量)
成对比较
数据挖掘
机器学习
星团(航天器)
过程(计算)
人工智能
特征(语言学)
任务(项目管理)
人工神经网络
工程类
地理
语言学
哲学
大地测量学
系统工程
程序设计语言
操作系统
作者
Hua Xu,Hanlei Zhang,Ting-En Lin
出处
期刊:SpringerBriefs in computer science
日期:2023-01-01
卷期号:: 99-113
标识
DOI:10.1007/978-981-99-3885-8_8
摘要
Identifying new user intents is an essential task in the dialogue system. However, it is hard to get satisfying clustering results since the definition of intents is strongly guided by prior knowledge. Existing methods incorporate prior knowledge by intensive feature engineering, which not only leads to overfitting but also makes it sensitive to the number of clusters. In this chapter, we introduce constrained deep adaptive clustering with cluster refinement (CDAC+), an end-to-end clustering method that can naturally incorporate pairwise constraints as prior knowledge to guide the clustering process. Moreover, the clusters are refined by forcing the model to learn from the high confidence assignments. After eliminating low confidence assignments, the approach presented is surprisingly insensitive to the number of clusters. Experimental results on the three benchmark datasets show that the method presented can yield significant improvements over strong baselines.
科研通智能强力驱动
Strongly Powered by AbleSci AI