Plants are in constant interaction with a myriad of soil microorganisms in the rhizosphere, an area of soil in close contact with plant roots. Recent research has highlighted the importance of plant-specialized metabolites (PSMs) in shaping and modulating the rhizosphere microbiota; however, the molecular mechanisms underlying the establishment and function of the microbiota mostly remain unaddressed. Flavonoids and saponins are a group of PSMs whose biosynthetic pathways have largely been revealed. Although these PSMs are abundantly secreted into the rhizosphere and exert various functions, the secretion mechanisms have not been clarified. This review summarizes the roles of flavonoids and saponins in the rhizosphere with a special focus on interactions between plants and the rhizosphere microbiota. Furthermore, this review introduces recent advancements in the dynamics of these metabolites in the rhizosphere and indicates potential applications of PSMs for crop production and discusses perspectives in this emerging research field.