Infrastructure monitoring applications can require the tracking of slowly moving points of a certain structure. Given a certain point from a structure to be monitored, in the context of available spaceborne synthetic aperture radar (SAR) products, where the image is already focused in a slant range-azimuth grid, it is not obvious if this point is the scattering center, if it is in layover or if it is visible from the respective orbit. This paper proposes a scattering centers detection and tracking procedure based on refocusing a set of SAR images on a provided high-resolution grid of the structure. The refocusing procedure is designed for high-resolution spotlight and sliding spotlight SAR images and consists of an azimuth defocusing followed by a modified backprojection algorithm on the given set of points. The scattering centers of the refocused image are detected in the 4-D tomography framework by testing if the main response is at zero elevation in the local elevation–velocity spectral distribution obtained using the Capon estimator. The mean displacement velocity is estimated from the peak response on the zero elevation axis, whereas the displacements time series for detected single scatterers is obtained as phase difference of complex amplitudes. The algorithm is tested by simulations with an emphasis on its behavior for a low number of satellite passes and applied on real data acquired with the TerraSAR-X satellite over the Puylaurent dam. The relative displacements between scattering regions show very good agreement with in situ measurements.