Abstract In this study, 18 Tibetan sheep were assigned into four groups by age and sex, namely young ewes (E1, n = 5), young rams (R1, n = 3), adult ewes (EA, n = 5) and adult rams (RA, n =5) to profile the bacterial composition of Tibetan sheep and to explore the impacts of sex and age on rumen microbiota using high-throughput sequencing method of amplicon of 16S rRNA V3–V4 region. The results indicated that all effective tags for 18 samples were clustered into 5429 OTUs (Operation taxonomic Units, OTUs) with an absolute abundance > 1 at a similarity level > 97%. The rumen bacterial composition of female adult sheep was more diverse than male adult sheep and yearling female sheep. SILVA database was used to annotate taxonomic information for each representative sequence using the RDP classifier, the results showed that Bacteroidetes, Firmicutes, Verrucomicrobia and Proteobacteria were the most dominant phyla, representing 56.68%, 28.81%, 6.71% and 1.73% of reads from all samples on average, respectively. At the genus level, Rikenellaceae_RC9_gut_group, and Prevotella_1 were most abundant with relative abundance of 12.98% and 11.19%, respectively. Relative abundance of Bacteroidetes in EA was greater than RA (p = 0.014), relative abundance of Firmicutes in RA was greater than EA (p