The German Aerospace Center (DLR) Institute of Space Propulsion has unique expertise in operating test facilities for rocket engine testing and development in Europe since 1959. However, essential elements of the test site were designed up to half a century ago. In order to ensure a futureproof and intelligent digital test infrastructure, the potential of test automation, advanced control, and monitoring systems is investigated based on machine learning. Such intelligent control systems are expected to reduce engine development and test preparation times, thereby lowering the associated costs. Additionally, advanced monitoring systems are anticipated to increase the safety and reliability of the test infrastructure. This paper presents the results of two pilot projects: the first project uses reinforcement learning to automatically generate test sequences based on test requirements, while the second project develops a feed-forward forecasting model to predict deviations from expected behavior in the feed-line of a rocket engine test facility.