Motivated by historical and present clinical observations, we discuss the possible unfavorable evolution of the immunity (similar to documented antibody-dependent enhancement scenarios) after a first infection with COVID-19. More precisely we ask the question of how the epidemic outcomes are affected if the initial infection does not provide immunity but rather sensitization to future challenges. We first provide background comparison with the 2003 SARS epidemic. Then we use a compartmental epidemic model structured by immunity level that we fit to available data; using several scenarios of the fragilization dynamics, we derive quantitative insights into the additional expected numbers of severe cases and deaths.