Photon-subtracted and photon-added Gaussian states are amongst the simplest non-Gaussian states that are experimentally available. It is generally believed that they are some of the best candidates to enhance sensitivity in parameter extraction. We derive here the quantum Cramér-Rao bound for such states and find that for large photon numbers photon-subtraction or -addition only leads to a small correction of the quantum Fisher information (QFI). On the other hand a divergence of the QFI appears for very small squeezing in the limit of vanishing photon number in the case of photon subtraction, implying an arbitrarily precise measurement with almost no light. However, at least for the standard and experimentally established preparation scheme, the decreasing success probability of the preparation in that limit exactly cancels the divergence, leading to finite sensitivity per square root of Hertz, when the duration of the preparation is taken into account.