Computer vision‐based recognition of 3D relationship between construction entities for monitoring struck‐by accidents

Abstract Struck‐by accidents often cause serious injuries in construction. Monitoring of the struck‐by hazards in terms of spatial relationship between a worker and a heavy vehicle is crucial to prevent such accidents. The computer vision‐based technique has been put forward for monitoring the struck‐by hazards but there exists shortages such as spatial relationship distortion due to two‐dimensional (2D) image pixels‐based estimation and self‐occlusion of heavy vehicles. This study is aimed to address these problems, including the detection of workers and heavy vehicles, three‐dimensional (3D) bounding box reconstruction for the detected objects, depth and range estimation in the monocular 2D vision, and 3D spatial relationship recognition. A series of experiments were conducted to evaluate the proposed method. The proposed method is expected to estimate 3D spatial relationship between construction worker and heavy vehicle in a real‐time and view‐invariant manner, thus enhancing struck‐by hazards monitoring at the construction site.