Among angiosperms there is a high degree of variation in embryo/endosperm size in mature seeds. However, little is known about the molecular mechanism underlying size control between these neighboring tissues. Here we report the rice GIANT EMBRYO (GE) gene that is essential for controlling the size balance. The function of GE in each tissue is distinct, controlling cell size in the embryo and cell death in the endosperm. GE, which encodes CYP78A13, is predominantly expressed in the interfacing tissues of the both embryo and endosperm. GE expression is under negative feedback regulation; endogenous GE expression is upregulated in ge mutants. In contrast to the loss-of-function mutant with large embryo and small endosperm, GE overexpression causes a small embryo and enlarged endosperm. A complementation analysis coupled with heterofertilization showed that complementation of ge mutation in either embryo or endosperm failed to restore the wild-type embryo/endosperm ratio. Thus, embryo and endosperm interact in determining embryo/endosperm size balance. Among genes associated with embryo/endosperm size, REDUCED EMBRYO genes, whose loss-of-function causes a phenotype opposite to ge, are revealed to regulate endosperm size upstream of GE. To fully understand the embryo–endosperm size control, the genetic network of the related genes should be elucidated.