A multi-species pest recognition and counting method based on a density map in the greenhouse

Whiteflies and fruit flies are common pests that adversely affect greenhouse crops, so it is vital to control their numbers promptly. Current research involves setting up artificial monitoring devices with fixed yellow sticky traps (YSTs), for pest surveillance. However, these devices can only be installed in specific environments and additional interventions may impact the actual distribution of greenhouse pests. On the other hand, detection methods, which are the most commonly used, struggle to accurately detect overlapping or closely interacting small insects, which is a common occurrence in the presence of pests. In this paper, we propose a novel solution for the multi-species pest recognition and counting method based on a density map to tackle pest counting in the greenhouse. To reduce interference between different types of objects, we used two annotation maps to represent the distribution of each object separately. Then, two counting branches are designed to count the pests, respectively. Finally, the detected pests are mapped onto the original image to display their spatial positions. In addition, an adaptive sample equalization method is proposed to address the issue of class imbalance in images, and the atrous spatial pyramid pooling (ASPP) structure and the CBAM attention mechanism are added to the fruit fly branches to focus on learning fruit fly features from crowded edges of YSTs. When applied to split images, our method achieved reliable counting performance in counting both whiteflies and fruit flies, with R2 scores of 0.973 and 0.972, respectively. This method has been embedded into mobile devices to assist greenhouse workers in monitoring pest populations in the field. The experiments show that the proposed method provides a promising direction for counting multiple small target insects and monitoring pest populations in crowded images. At the same time, it demonstrates the potential of density map methods in various small target detection scenarios.