Research on Talent Demand Analysis in Big Data Related Fields Based on Text Mining

This article addresses the issue of talent shortage in the current big data industry by precisely identifying the required skills for job roles. The method involves obtaining job postings from enterprises on recruitment websites, preprocessing the text data, and combining Word2Vec to construct word vectors and K-means clustering for text mining. The results divide big data job roles into six categories with basic skill requirements divided into eight categories. By comparing and analyzing the differences in experience, education, and basic skills requirements among different job roles, this research provides management guidance for the precise training of big data talents to improve talent development efficiency and meet market demands.