Seru production is one of the latest manufacturing modes arising from Japanese production practice. Seru can achieve efficiency, flexibility, and responsiveness simultaneously. To accommodate the current business environment with volatile demands and fierce competitions, seru has attracted more and more attention both from researchers and practitioners. A new planning management system, just-in-time organization system (JIT-OS), is used to manage and control a seru production system. The JIT-OS contains two decisions: seru formation and seru loading. By seru formation, a seru system with one or multiple appropriate serus is configured; by seru loading, customer ordered products are allocated to serus to implement production plans. In the process of seru formation, workers have to be assigned to serus. In this paper, a seru loading problem with worker assignment is constructed as a bi-level programming model, and the worker assignment on the upper level is to minimize total idle time while the lower level is to minimize the makespan by finding out optimal product allocation. A product lot can be splitted and allocated to different serus. The problem of this paper is shown to be NP-hard. Therefore, a simulated annealing and genetic algorithm (SA-GA) is developed. The SA is for the upper level programming and the GA is for the lower level programming. The practicality and effectiveness of the model and algorithm are verified by two numerical examples, and the results show that the SA-GA algorithm has good scalability.