In plants, as in animals, organ growth depends on mechanical interactions between cells and tissues, and is controlled by both biochemical and mechanical cues. Here, we investigate the control of seed size, a key agronomic trait, by mechanical interactions between two compartments: the endosperm and the testa. By combining experiments with computational modelling, we present evidence that endosperm pressure plays two antagonistic roles: directly driving seed growth, but also indirectly inhibiting it through tension it generates in the surrounding testa, which promotes wall stiffening. We show that our model can recapitulate wild type growth patterns, and is consistent with the small seed phenotype of the haiku2 mutant, and the results of osmotic treatments. Our work suggests that a developmental regulation of endosperm pressure is required to prevent a precocious reduction of seed growth rate induced by force-dependent seed coat stiffening.