Given the challenges facing on-site analysis, molecularly imprinted polymers (MIPs) based optical fiber (OF) sensors are earning worldwide attention because of their integration of high specificity (from MIPs) and flexible sensing ability (from OF sensors). As such, how to design an efficient MIPs based OF sensor becomes a timely research topic. In this review, we discuss the state-of-the-art of MIPs based OF sensors, including the simply combined MIP/OF sensors and the directly integrated [email protected] sensors. We first summarize the progress of MIP/OF sensors using MIPs as solid phase extraction materials and binding films. In addition, we give a comprehensive overview of the [email protected] sensors, with an emphasis on fluorescence, surface plasmon resonance (SPR), gratings, interferometry, lossy mode resonance and intensity distribution based [email protected] sensors. Finally, the challenges and future perspectives of the on-site applications of these sensors are highlighted.