SFC Orchestration Method for Edge Cloud and Central Cloud Collaboration: QoS and Energy Consumption Joint Optimization Combined With Reputation Assessment
期刊:IEEE Transactions on Parallel and Distributed Systems [Institute of Electrical and Electronics Engineers] 日期:2023-08-03卷期号:34 (10): 2735-2748被引量:2
标识
DOI:10.1109/tpds.2023.3301670
摘要
Network function virtualization (NFV) is an emerging technology that uses virtualization technology to provide various services in enterprise networks and reduce costs. However, in cloud edge networks, effective virtual network function (VNF) configuration is particularly difficult, and the system design needs to consider the reliability and energy-saving while meeting the requirements of Quality of Service (QoS). This paper uses the binary integer programming (BIP) model to study the service function chain (SFC) orchestration problem, and designs a federated deep reinforcement learning SFC orchestration algorithm (FDOA). With this method, energy consumption can be reduced and the QoS of users can be improved. In addition, considering the limitations of local deep reinforcement learning (DRL) model training, this paper proposes a federated DRL algorithm to help obtain a more robust model, and simultaneously improve the convergence speed of the model. Among them, we introduce reputation theory during model training to evaluate the reliability of the nodes carrying the DRL model, avoiding the influence of unreliable models on the training effect. Finally, the simulation results show that FDOA has better performance in training time and end-to-end delay compared with other existing algorithms.