The protein kinase A (PKA) signaling pathway, which mediates protein phosphorylation, is important for sperm motility and male fertility. This process relies on A-kinase anchoring proteins that organize PKA and its signalosomes within specific subcellular compartments. Previously, it was found that the absence of A-kinase anchoring protein 3 (AKAP3) leads to multiple morphological abnormalities in mouse sperm. But how AKAP3 regulates sperm motility is yet to be elucidated. AKAP3 has two amphipathic domains, here named dual and RI, in its N-terminus. These domains are responsible for binding regulatory subunits I alpha (RIα) and II alpha (RIIα) of PKA and for RIα only, respectively. Here, we generated mutant mice lacking the dual and RI domains of AKAP3. It was found that the deletion of these domains caused male mouse infertile, accompanied by mild defects in the fibrous sheath of sperm tails. Additionally, the levels of serine/threonine phosphorylation of PKA substrates and tyrosine phosphorylation decreased in the mutant sperm, which exhibited a defect in hyperactivation under capacitation conditions. The protein levels of PKA subunits remained unchanged. But, interestingly, the regulatory subunit RIα was mis-localized from principal piece to midpiece of sperm tail, whereas this was not observed for RIIα. Further protein-protein interaction assays revealed a preference for AKAP3 to bind RIα over RIIα. Collectively, our findings suggest that AKAP3 is important for sperm hyperactivity by regulating type-I PKA signaling pathway mediated protein phosphorylation via its dual and RI domains.