We show the existence and uniqueness of fundamental solution operators to Kolmo\-gorov-Fokker-Planck equations with rough (measurable) coefficients and local or integral diffusion on finite and infinite time strips. In the local case, that is to say when the diffusion operator is of differential type, we prove $\L^2$ decay using Davies' method and the conservation property. We also prove that the existence of a generalized fundamental solution with the expected pointwise Gaussian upper bound is equivalent to Moser's $\L^2-\L^\infty$ estimates for local weak solutions to the equation and its adjoint. When coefficients are real, this gives the existence and uniqueness of such a generalized fundamental solution and a new and natural way to obtain pointwise decay.