Anaplasmosis poses a great threat to the livestock industry and human health in most tropical and subtropical regions of the world. This study investigated the presence of Anaplasma in sheep from Heilongjiang Province, northeastern China. A total of 341 blood samples were detected by PCR with species-specific primers based on the msp4 gene of Anaplasma ovis, 16S rRNA gene of Anaplasma phagocytophilum and Anaplasma bovis and gltA gene of Anaplasma capra. The results showed that Anaplasma infection was found in 103 (30.2%) of 341 sheep. The infection rates were 2.6%, 8.8%, 15.8% and 10.0% for A. ovis, A. phagocytophilum, A. bovis and A. capra in sheep, respectively. Co-infection involving two Anaplasma species was found in 25 sheep (8.0%), which were usually A. phagocytophilum and A. bovis (72.0%). Co-infection involving A. phagocytophilum, A. capra, A. ovis with zoonotic potential, was found in one sheep. Sequence analysis revealed that the isolates of A. ovis, A. bovis and A. phagocytophilum identified in sheep were closely related to those previously reported in ticks and other animal hosts. Phylogenetic analysis showed that A. capra could be classified into two distinct clusters based on the gltA gene and the isolates identified in sheep from this study were clustered in the A. capra genotype II, which was clearly distinct with the human isolates. The findings in this study report four Anaplasma species and a novel A. capra genotype in sheep from northeastern China, and improve our knowledge of Anaplasma, contributing to the control of ovine anaplasmosis.