This paper presents the control of a quadrotor with a cable-suspended payload. The proposed control structure is a hierarchical scheme consisting of an energy-based control (EBC) to stabilize the vehicle translational dynamics and to attenuate the payload oscillation, together with a nonlinear state feedback controller based on an linear matrix inequality (LMI) to control the quadrotor rotational dynamics. The payload swing control is based on an energy approach and the passivity properties of the system’s translational dynamics. The main advantage of the proposed EBC strategy is that it does not require excessive computations and complex partial differential equations (PDEs) for implementing the control algorithm. We present a new methodology for using an LMI to synthesize the controller gains for Lipschitz nonlinear systems with larger Lipschitz constants than other classical techniques based on LMIs. This theoretical approach is applied to the quadrotor rotational dynamics. Stability proofs based on the Lyapunov theory for the controller design are presented. The designed control scheme allows for the stabilization of the system in all its states for the three-dimensional case. Numerical simulations demonstrating the effectiveness of the controller are provided.