Deep learning in the development of energy Management strategies of hybrid electric Vehicles: A hybrid modeling approach

The Energy Management Strategy (EMS) in an HEV is the key for improving fuel economy and simultaneously reducing pollutant emissions. This paper presents a methodology for developing hybrid models that enable EMS testing as well as the evaluation of fuel consumption, CO2 and pollutant emissions (CO, NOx and THC). In this context, pollutant emissions are hard to quantify with static models such as the well-known map-based approach which is mainly due to the pronounced impact of transient effects. The novelty of this paper primarily comes from the characterization of pollutant emissions through Convolutional Neural Networks (CNN), providing high accuracy for both, instantaneous and cumulative values. The input parameters are classical Internal Combustion Engine (ICE) measurements such as engine speed, air mass flow, torque and exhaust temperature. The proposed CNNs are reduced to a minimum for low complexity and fast computability. These models are developed with experimental data from chassis dyno testing of a conventional turbo-charged gasoline engine vehicle. The pollutant emission models are used in conjunction with physical models of the remaining powertrain allowing for real time simulations of the complete HEV vehicle. The Double Deep-Q learning algorithm is proposed for the EMS and compared to the Dynamic programming (DP) solution. The introduced methodology is developed in a co-simulation framework between MATLAB-Simulink and AMESIM. The resulting model runs between 8 and 10 times faster than real time in an off-the-shelf PC. This provides the capability for developing models suitable for HIL (hardware-in-the-loop) and SIL (software-in-the-loop) applications. The final error in predicted CO2 remains below 2.5% while the final cumulative error for pollutants is below 8.5% in the case of CO and HC emissions.