The modular data of a modular category C, consisting of the S-matrix and the T-matrix, is known to be a incomplete invariant of C. More generally, the invariants of framed links and knots defined by a modular category as part of a topological quantum field theory can be viewed as numerical invariants of the category. Among these invariants, we study the invariant defined by the Borromean link colored by three objects. Thus we obtain a tensor that we call B. We derive a formula for the Borromean tensor for the twisted Drinfeld doubles of finite groups. Along with T , it distinguishes the p non-equivalent modular categories of the form Z(Vec^ω_G) for G the non-abelian group of order pq, which are not distinguished by the modular data.