An important task in mathematical sciences is to make quantitative predictions, which is often done via the solution of differential equations. In this paper, we investigate why, to perform this task, scientists sometimes choose to use numerical methods instead of analytical solutions. Via several examples, we argue that the choice for numerical methods can be explained by the fact that, while making quantitative predictions seems at first glance to be facilitated with analytical solutions, this is actually often much easier with numerical methods. Thus we challenge the widely presumed superiority of analytical solutions over numerical methods.