AbstractConstruction sites have complex environments and high accident rates. Human intrusion into static hazardous areas is a significant cause of accidents. Traditional engineering safety management mainly relies on manual methods, such as patrol inspection by safety supervisors, which is time-consuming and labor-intensive, and it is difficult to achieve a complete safety supervision. In recent years, the emergence of artificial intelligence technology and computer vision has provided a new scheme for intrusion detection. However, existing studies have used a single method for human intrusion judgment in static dangerous areas, without in-depth consideration of the influence of human posture, intrusion direction, and other factors. In this study, a computer vision–based intrusion detection method was developed, mainly aimed at static hazardous areas. The object detection was based on the You Only Look Once (YOLO) V5 module to extract the image feature information. Subsequently, the basic rule of intrusion judgment based on the key points of bounding boxes was formulated, in which the workers’ intrusion direction was recognized and postured using two auxiliary detection modules. Finally, the intrusion rule base was constructed as the basis for human intrusion detection, containing rules with different sensitivities for different intrusion states. The case study indicated that the precision and recall rate of the algorithm were 96.05% and 90.05%, respectively. Overall, this method can effectively address the defects of manual supervision in engineering safety management, reducing the probability of accident occurrence and enhancing safety at construction sites.