Explainable deep recurrent neural networks for the batch analysis of a pharmaceutical tableting process in the spirit of Pharma 4.0

Due to the continuously increasing Cost of Goods Sold, the pharmaceutical industry has faced several challenges, and the Right First-Time principle with data-driven decision-making has become more pressing to sustain competitiveness. Thus, in this work, three different types of artificial neural network (ANN) models were developed, compared, and interpreted by analyzing an open-access dataset from a real pharmaceutical tableting production process. First, the multilayer perceptron (MLP) model was used to describe the total waste based on 20 raw material properties and 25 statistical descriptors of the time series data collected throughout the tableting (e.g., tableting speed and compression force). Then using 10 process time series data in addition to the raw material properties, the cumulative waste, during manufacturing was also predicted by long short-term memory (LSTM) and bidirectional LSTM (biLSTM) recurrent neural networks (RNN). The LSTM network was used to forecast the waste production profile to allow preventive actions. The results showed that RNNs were able to predict the waste trajectory, the best model resulting in 1096 and 2174 tablets training and testing root mean squared errors, respectively. For a better understanding of the process, and the models and to help the decision-support systems and control strategies, interpretation methods were implemented for all ANNs, which increased the process understanding by identifying the most influential material attributes and process parameters. The presented methodology is applicable to various critical quality attributes in several fields of pharmaceutics and therefore is a useful tool for realizing the Pharma 4.0 concept.