Acoustic imaging techniques are powerful, non-destructive tools used to perform elastic imaging of systems. Acoustic imaging techniques have a large variety of applications in both industrial and fundamental research. Acoustic wave generation in the GHz range using picosecond acoustics has enabled the development of elastic images with nanometric in-depth resolution. However, the spatial lateral resolution for this imaging technique is limited by the laser spot size, which cannot be reduced below a couple hundred nanometers due to light diffraction. In this paper, we report the first results of a new approach in which we couple time-resolved pump-probe spectroscopy and atomic force microscopy. We generate GHz-waves directly into an AFM probe from the top of the probe. Acoustic transmission from the probe to the sample is also achieved, which paves the way to perform sub-surface imaging. Due to the nanometric radius size of the commercial tip, acoustic imaging with an improved lateral resolution could be achieved. These results are an encouraging step toward the development of a new acoustic microscopy technique.