Instabilities caused during the erosion of a surface by an ion beam can lead to the formation of self-organized patterns of nanostructures. Understanding the self-organization process requires not only the in-situ characterization of ensemble averaged properties but also probing the dynamics. This can be done with the use of coherent X-rays and analyzing the temporal correlations of the scattered intensity. Here, we show that the dynamics of a semiconductor surface nanopatterned by normal incidence ion beam sputtering are age-dependent and slow down with sputtering time. This work provides a novel insight into the erosion dynamics and opens new perspectives for the understanding of self-organization mechanisms.