Hyperspectral Imaging coupled with Deep Learning Model for Visualization and Detection of Early Bruises on Apples

Early bruise on apples caused by external impacts during the transportation process is commonly difficult to be detected on the apple surface, limiting the application of traditional machine vision methods in determining fruit quality. In recent years, hyperspectral imaging (HSI) has emerged as a promising technology for identifying early bruise of fruits due to its efficient and nondestructive detection. In this study, HSI data in the shortwave infrared range were collected at 2-hour and 6-hour intervals after mechanical damage. The combination of the successive projections algorithm (SPA) and principal component analysis (PCA) was used to select three key feature bands, namely, 1074 nm, 1269 nm and 1441 nm. Pseudo color transformation and band ratio algorithm were then employed to improve the contrast between damaged and healthy apple tissues for image enhancement. The fast and precise YOLOv5 (FP-YOLOv5) model achieved effective identification of apple bruises, with a high recognition rate of 95% and a fast detection speed at 130 fps. Overall, the proposed framework based on band selection and image enhancement exhibits better performance in the detection of early apple bruises, providing useful insights for HSI combined with a deep learning model in the grading evaluation of fruit quality.