LiDAR (Light Detection And Ranging) acquisition is a widespread method for measuring urban scenes, be it a small town neighborhood or an entire city. It is even more interesting when this acquisition is coupled with a collection of pictures registered with the data, permitting to recover the color information of the points. Yet, this added color can be perturbed by shadows that are very dependent on the sun direction and weather conditions during the acquisition. In this paper, we focus on the problem of automatically detecting and correcting the shadows from the LiDAR data by exploiting both the images and the point set laser reflectance. Building on the observation that shadow boundaries are characterized by both a significant color change and a stable laser reflectance, we propose to first detect shadow boundaries in the point set and then segment ground shadows using graph cuts in the image. Finally using a simplified illumination model we correct the shadows directly on the colored point sets. This joint exploitation of both the laser point set and the images renders our approach robust and efficient, avoiding user interaction.