An intelligent and automated 3D surface defect detection system for quantitative 3D estimation and feature classification of material surface defects

To evaluate defects on the surface of the materials at the 3D level accurately and quantitatively, a 3D surface defect detection system based on stereo vision is presented, which can extract the precise 3D defect features of the detected object. The proposed detection system consists of two image capture modules and a turntable to capture the complete 3D information and color texture information from the object surface. More precisely, each image capture module is a binocular stereo vision system containing two monochrome cameras, a color camera, and a speckle projector which is used to reconstruct the 3D point clouds of the object surface based on stereo digital image correlation (stereo-DIC). Furthermore, a point-image mapping relationship between the reconstructed 3D object points and the color images is established. Eventually, the 3D characteristic parameters of defects are calculated by the corresponding 3D point cloud of the defect area obtained by segmenting the defect area using the image segmentation and point cloud segmentation algorithms according to this point-image mapping relationship. A convolutional neural network named DenseNets is employed to identify defect types intelligently. A high-precision multi-camera calibration method based on close-range photogrammetry is applied to ensure system detection accuracy in the proposed system. The experimental results demonstrate that the system has higher accuracy and better performance in system calibration, 3D reconstruction, and defect feature calculation.