Network Log Big Data Analysis Processing Based on Hadoop Cluster

Analysis of large website log big data, can effectively get the user access website various related report data, such as website click rate, each country IP address, extract and splicing log key fields, etc., by refining valuable data information, realize the website intrusion detection and operation status monitoring, and can effectively provide basis for further development of user recommendation system.