To address the lack of training data for driverless train operation, this paper presents the RailGoerl24 dataset, a 12,205-frame high-definition image dataset captured at the TÜV SÜD Rail Railway Test Center in Görlitz, Germany. This dataset was designed to support the development of machine learning algorithms for automatically detecting people within dangerous zones on trains and contains 33,556 box-shaped annotations for "person" objects. In addition to RGB image data, it also includes terrestrial LiDAR scan data covering a limited area. Face information is unblurred and can be used for various tasks beyond collision prediction. The dataset is available at data.fid-move.de/dataset/railgoerl24.