The intermitochondrial cement (IMC) and chromatoid body (CB) are posited as central sites for piRNA activity in mice, with MIWI initially assembling in the IMC for piRNA processing before translocating to the CB for functional deployment. The regulatory mechanism underpinning MIWI translocation, however, has remained elusive. We unveil that piRNA loading is the trigger for MIWI translocation from the IMC to CB. Mechanistically, piRNA loading facilitates MIWI release from the IMC by weakening its ties with the mitochondria-anchored TDRKH. This, in turn, enables arginine methylation of MIWI, augmenting its binding affinity for TDRD6 and ensuring its integration within the CB. Notably, loss of piRNA-loading ability causes MIWI entrapment in the IMC and its destabilization in male germ cells, leading to defective spermatogenesis and male infertility in mice. Collectively, our findings establish the critical role of piRNA loading in MIWI translocation during spermatogenesis, offering new insights into piRNA biology in mammals.