The three-dimensional (3D) organization of chromosomes is emerging as an important determinant of multiple cellular processes. We now show that 3D chromatin structures, maintained by the Polycomb complex, record epigenetic perturbation events.