The core valence separation (CVS) approximation is the most employed strategy to prevent the variational collapse of standard wave function optimization when attempting to compute electronic states bearing one or more electronic vacancies in core orbitals. Here, we explore the spurious consequences of this approximation on the properties of the computed core hole states. We especially focus on the less studied case of double core hole (DCH) states, whose spectroscopic interest has recently been rapidly growing. We show that the CVS error leads to a systematic underestimation of DCH energies, a property in stark contrast with the case of single core hole states. We highlight that the CVS error can then be interpreted as an over relaxation effect and design a new correction strategy adapted to these specificities.