A Competency Mining Method Based on Latent Dirichlet Allocation (LDA) Model

Abstract A text mining approach based on latent Dirichlet allocation (LDA) is proposed to analyze the competency characteristics. First, we briefly introduce the principle and hypothesis of latent Dirichlet allocation (LDA) model. Second, we elaborate the idea of using LDA topic model to extract competency, Then, we use Chinese text materials such as biographies and interviews of Chinese scientific and technological talents as data sources to conduct experiments, and obtain four competency topics including knowledge, attitude, quality and values. The research results preliminarily verify the effectiveness of latent Dirichlet allocation (LDA) model in competency research, but there are still many details to be improved in the future.