The present research aims to develop a thermodynamically consistent framework for the application in the homogenization of finite strain thermoplasticity. The focus is set on the metallic materials, but the framework can be applied to other classes of materials as well. The cornerstone of the current research is the amount already existing results developed for the multiscale thermoelasticity. The essential part of the procedure is enforcement of consistency between thermodynamical quantities at macroscale and microscale levels. As will be demonstrated in the paper, such a consistency places additional constraints that are usually not accounted for in the literature. The developed procedure is implemented into the finite element framework, and performance is illustrated on two examples, one mechanically driven and the other thermally driven.