Histone H3 lysine 4 trimethylation (H3K4me3) is abundant in euchromatin and is in general associated with transcriptional activation in eukaryotes. Although some Arabidopsis thaliana SET DOMAIN GROUP (SDG) genes have been previously shown to be involved in H3K4 methylation, they are unlikely to be responsible for global genome-wide deposition of H3K4me3. Most strikingly, sparse knowledge is currently available about the role of histone methylation in gametophyte development. In this study, we show that the previously uncharacterized SDG2 is required for global H3K4me3 deposition and its loss of function causes wide-ranging defects in both sporophyte and gametophyte development. Transcriptome analyses of young flower buds have identified 452 genes downregulated by more than twofold in the sdg2-1 mutant; among them, 11 genes, including SPOROCYTELESS/NOZZLE (SPL/NZZ) and MALE STERILITY1 (MS1), have been previously shown to be essential for male and/or female gametophyte development. We show that both SPL/NZZ and MS1 contain bivalent chromatin domains enriched simultaneously with the transcriptionally active mark H3K4me3 and the transcriptionally repressive mark H3K27me3 and that SDG2 is specifically required for the H3K4me3 deposition. Our data suggest that SDG2-mediated H3K4me3 deposition poises SPL/NZZ and MS1 for transcriptional activation, forming a key regulatory mechanism in the gene networks responsible for gametophyte development.