Transcriptional activity and structure of chromatin are correlated with patterns of covalent DNA and histone modification. Previous studies have revealed that high levels of histone H3 dimethylation at lysine 9 (H3K9me2), characteristic of transcriptionally silent heterochromatin in Arabidopsis, require hypermethylation of DNA at CpG sites. Here, we report that CpG hypermethylation characteristic of heterochromatin specifically prevented H3K27 trimethylation (H3K27me3). H3K27 mono‐ and dimethylation mark silent heterochromatin independently of DNA methylation. Upon loss of CpG methylation, there was target‐specific enrichment of H3K27me3 in heterochromatin that correlated with transcriptional reactivation. Moreover, using the kyp mutant affected in H3K9me2, we showed that changes in H3K27me3 occurred independently of the levels of H3K9me2. Therefore, CpG methylation provides distinct and direct information for a specific subset of histone methylation marks. The observed independence of the regulation of H3K9 and H3K27 methylation by CpG methylation refines the recently proposed combinatorial histone code involving these two marks.