DNA mismatch repair (MMR) ensures replication fidelity by correcting mismatches generated during DNA replication. Although human MMR has been reconstituted in vitro, how MMR occurs in vivo is unknown. Here, we show that an epigenetic histone mark, H3K36me3, is required in vivo to recruit the mismatch recognition protein hMutSα (hMSH2-hMSH6) onto chromatin through direct interactions with the hMSH6 PWWP domain. The abundance of H3K36me3 in G1 and early S phases ensures that hMutSα is enriched on chromatin before mispairs are introduced during DNA replication. Cells lacking the H3K36 trimethyltransferase SETD2 display microsatellite instability (MSI) and an elevated spontaneous mutation frequency, characteristic of MMR-deficient cells. This work reveals that a histone mark regulates MMR in human cells and explains the long-standing puzzle of MSI-positive cancer cells that lack detectable mutations in known MMR genes.