ICRA: An Intelligent Clustering Routing Approach for UAV Ad Hoc Networks

As an important means of obtaining information of marine situation, the marine monitoring system relying on UAV has been paid more and more attention by all countries in the world, and the demand for tasks is growing continually. In UAV ad hoc networks, routing protocols with immutable routing policies that lack flexibility are generally incapable of maintaining effective performance due to the complicated and rapidly changing environmental situation and application requirements. In this paper, we propose an intelligent clustering routing approach (ICRA) for UANETs. The ICRA is composed of three components: the clustering module, the clustering strategy adjustment module and the routing module. In the clustering process, each node needs to calculate its utility. In order to maintain high topology stability and long network lifetime in different network states, the reinforcement learning based clustering strategy adjustment module needs continuous learning the benefits brought by adopting different strategies to calculate the nodes utility in a specific network state. With the learned knowledge, clustering strategy adjustment module could determine the optimal clustering strategy according to the current network state. In the routing phase, the proposed scheme can reduce the end-to-end delay and improve the packet delivery rate by introducing inter-cluster forwarding nodes to forward messages among different clusters. Extensive experiments have been conducted to verify ICRA’s robustness and superiority over existing schemes. The results demonstrate that ICRA could achieve better performance than its state-of-the-art counterparts with regard to the clustering efficiency, topology stability, energy efficiency and quality of service.