In this paper, we discuss properties, such as monotonicity and continuity, of the Gerstewitz's nonconvex separation functional. With the aid of this functional, necessary and sufficient optimality conditions for nonconvex optimization problems of set-valued mappings are obtained in topological vector spaces.