We retrospect three abstract models for heat engines which include a classic abstract model in textbook of thermal physics, a primary abstract model for finite-time heat engines, and a refined abstract model for finite-time heat engines. The detailed models of heat engines in literature of finite-time thermodynamics may be mapped into the refined abstract model. The future developments based on the refined abstract model are also surveyed.