Using a two-stage convolutional neural network to rapidly identify tiny herbivorous beetles in the field

Abstract

Recently, deep convolutional neural networks (CNN) have been adopted to help beginners identify insect species from field images. However, the application of these methods on the identification of tiny congeneric species moving across heterogeneous background remains difficult. To enable rapid and automatic identification in the field, we customized a method involving real-time object detection of two Phyllotreta beetles. We first performed data augmentation using transformations, syntheses, and random erasing of the original images. We then proposed a two-stage method for the detection and identification of small insects based on CNN, where YOLOv4 and EfficientNet were used as a region proposal network and a re-identification method, respectively. Evaluation of the model revealed that one-step object detection by YOLOv4 alone was not precise (Precision = 0.55) when classifying two species of flea beetles and background objects. In contrast, the two-step CNNs improved the precision (Precision = 0.89) with moderate accuracy (F-measure = 0.55) and acceptable speed (ca. 5 frames per second for full HD images) of detection and identification of insect species in the field. Although real-time identification of tiny insects remains a challenge in the field, our method aids in improving small object detection on a heterogeneous background.