Insomnia is a common sleep disorder without effective therapy and can affect a person's life. The mechanism of the disease is not completely understood. Hence, there is a need to understand the targets related to insomnia, in order to develop innovative therapies and new compounds. Recently, increasing interest has been focused on complementary and alternative medicines for treating or preventing insomnia. Research into their molecular components has revealed that their sedative and sleep-promoting properties rely on the interactions with various neurotransmitter systems in the brain. In this review, the role of 5-hydroxytryptamine (5-HT) in insomnia development is summarized, while a systematic analysis of studies is conducted to assess the mechanisms of herbal medicines on different 5-HT receptors subtypes, in order to provide reference for subsequent research.