RailFOD23: A dataset for foreign object detection on railroad transmission lines

Abstract Artificial intelligence models play a crucial role in monitoring and maintaining railroad infrastructure by analyzing image data of foreign objects on power transmission lines. However, the availability of publicly accessible datasets for railroad foreign objects is limited, and the rarity of anomalies in railroad image data, combined with restricted data sharing, poses challenges for training effective foreign object detection models. In this paper, the aim is to present a new dataset of foreign objects on railroad transmission lines, and evaluating the overall performance of mainstream detection models in this context. Taking a unique approach and leveraging large-scale models such as ChatGPT (Chat Generative Pre-trained Transformer) and text-to-image generation models, we synthesize a series of foreign object data. The dataset includes 14,615 images with 40,541 annotated objects, covering four common foreign objects on railroad power transmission lines. Through empirical research on this dataset, we validate the performance of various baseline models in foreign object detection, providing valuable insights for the monitoring and maintenance of railroad facilities.