The human gut symbiont Bacteroides fragilis has a general protein O-glycosylation system in which numerous extracytoplasmic proteins are glycosylated at a three amino acid motif. In B. fragilis, protein glycosylation is a fundamental and essential property as mutants with protein glycosylation defects have impaired growth and are unable to competitively colonize the mammalian intestine. In this study, we analysed the phenotype of B. fragilis mutants with defective protein glycosylation and found that the glycan added to proteins is comprised of a core glycan and an outer glycan. The genetic region encoding proteins for the synthesis of the outer glycan is conserved within a Bacteroides species but divergent between species. Unlike the outer glycan, an antiserum raised to the core glycan reacted with all Bacteroidetes species tested, from all four classes of the phylum. We found that diverse Bacteroidetes species synthesize numerous glycoproteins and glycosylate proteins at the same three amino acid motif. The wide-spread conservation of this protein glycosylation system within the phylum suggests that this system of post-translational protein modification evolved early, before the divergence of the four classes of Bacteroidetes, and has been maintained due to its physiological importance to the diverse species of this phylum.