Combining DNA damage repair inhibitors and chemotherapeutic agents is an emerging strategy in cancer treatment. In this study, we engineered the polycation nanoparticle (NP), which co-encapsulated DNA damage repair inhibitor Dbait and chemotherapeutic drug Docetaxel (Dtxl), using H1 nanopolymer (folate--polyethylenimine600-cyclodextrin), and the size of H1/Dbait/Dtxl was about 117 nm. We demonstrated that H1/Dbait/Dtxl enhanced the efficiency of radio-chemotherapy in prostate cancer cells by CCK-8 assay and colony-forming assay. Importantly, the improvement of radio-chemotherapy of H1/Dbait/Dtxl in prostate cancer was also validated in vivo, and the NP did not have a high toxicity profile. The results of immunohistochemistry and western blot supported that the improved therapeutic efficacy was through inhibiting DNA damage repair signalling pathway. Our study supports further investigations using NP to co-deliver DNA damage repair inhibitors and chemotherapeutics to improve the therapeutic efficacy of cancer.