This article surveys the classical techniques of nonlinear optimal control such as the Pontryagin Maximum Principle and the conjugate point theory, and how they can be implemented numerically, with a special focus on applications to aerospace problems. In practice the knowledge resulting from the maximum principle is often insufficient for solving the problem in particular because of the well-known problem of initializing adequately the shooting method. In this survey article it is explained how the classical tools of optimal control can be combined with other mathematical techniques so as to improve significantly their performances and widen their domain of application. The focus is put onto three important issues. The first is geometric optimal control, which is a theory that has emerged in the 80's and is combining optimal control with various concepts of differential geometry, the ultimate objective being to derive optimal synthesis results for general classes of control systems. Its applicability and relevance is demonstrated on the problem of atmospheric re-entry of a space shuttle. The second is the powerful continuation or homotopy method, consisting of deforming continuously a problem towards a simpler one, and then of solving a series of parametrized problems so as to end up with the solution of the initial problem. After having recalled its mathematical foundations, it is shown how to combine successfully this method with the shooting method on several aerospace problems such as the orbit transfer problem. The third one consists of concepts of dynamical system theory, providing evidence of nice properties of the celestial dynamics that are of great interest for future mission design such as low cost interplanetary space missions. The article ends with open problems and perspectives.