We give an elementary proof of the classical Hardy inequality on any Carnot group, using only integration by parts and a fine analysis of the commutator structure, which was not deemed possible until now. We also discuss the conditions under which this technique can be generalized to deal with hypoelliptic families of vector fields, which, in this case, leads to an open problem regarding the symbol properties of the gauge norm.