In recent years, since water pollution has aroused great public concern, various carbon materials have already been widely applied for water treatment. In this respect, tremendous effort has been made to provide different synthesis methods of carbon materials. Among all carbon materials, metal-organic framework (MOF) derived carbon has always been favored as it possesses several appealing merits such as high specific surface area, large pore volume, and outstanding chemical stability. This review presents the latest development of MOFs as templates and precursors for the fabrication of various carbon materials, including porous carbon, nanocarbon, and graphene, which are pyrolyzed at different temperatures. The article also emphasizes on their future trends and perspectives on the application of water treatment.