The use of satellite Sea Surface Temperature (SST) fields to retrieve zonal and meridional surface currents (U,V) is now a widespread idea. Since the classical approach involves temporal differencing of SST fields, we investigate in this paper the extent to which mesoscale ocean dynamics may be decomposed into a superposition of dynamical modes, characterized by different linear relationships between surface currents and temperature fields. Based on a completely observation-driven approach, we propose a latent class regression model from local satellite surface currents and patches of SST measurements. Applied to the highly dynamical Agulhas region, we demonstrate and discuss the geophysical relevance of the proposed mixture model to achieve a spatio-temporal segmentation and tracking of the ocean surface dynamical modes. Moreover, we show the accuracy of the proposed model to predict mesoscale surface currents from SST single maps.