Gibberellins (GAs) play crucial roles in regulating plant architecture and grain yield of crops. In rice, the inactivation of endogenous bioactive GAs and their precursors by GA 2-oxidases (GA2oxs) regulates stem elongation and reproductive development. However, the regulatory mechanisms of GA2ox gene expression, especially in rice reproductive organs, are unknown. The BEL1-like homeodomain protein OsBLH4, a negative regulatory factor for the rice OsGA2ox1 gene, was identified in this study. Loss of OsBLH4 function results in decreased bioactive GA levels and pleiotropic phenotypes, including reduced plant height, decreased grain number per panicle, and delayed heading date, as also observed in OsGA2ox1-overexpressing plants. Consistent with the mutant phenotype, OsBLH4 was predominantly expressed in shoots and young spikelets; its encoded protein was exclusively localized in the nucleus. Molecular analysis demonstrated that OsBLH4 directly bound to the promoter region of OsGA2ox1 to repress its expression. Genetic assays revealed that OsBLH4 acts upstream of OsGA2ox1 to control rice plant height, grain number, and heading date. Taken together, these results indicate a crucial role for OsBLH4 in regulating rice plant architecture and yield potential via regulation of bioactive GA levels, and provide a potential strategy for genetic improvements of rice.