We derive semiclassical equations of motion for an accelerated wave packet in a two-band system. We show that these equations can be formulated in terms of the static band geometry described by the quantum metric. We consider the specific cases of the Rashba Hamiltonian with and without a Zeeman term. The semiclassical trajectories are in full agreement with the ones found by solving the Schrödinger equation. This formalism successfully describes the adiabatic limit and the anomalous Hall effect traditionally attributed to Berry curvature. It also describes the opposite limit of coherent band superposition, giving rise to a spatially oscillating Zitterbewegung motion, and all intermediate cases. At $k=0$, such a wave packet exhibits a circular trajectory in real space, with its radius given by the square root of the quantum metric. This quantity appears as a universal length scale, providing a geometrical origin of the Compton wavelength. The quantum metric semiclassical approach could be extended to an arbitrary number of bands.