Several reinforcement techniques are compared to take control of Unmanned Aerial Vehicles (UAVs) and optimize communication offloading in cellular networks. Navigation actions are calculated to send the drones to the required position and turn them back when not needed. First, a use case is expressed and solved in form of a linear programming problem (ILP). Then, a Q learning algorithm is designed and evaluated to solve the same problem. Finally, a deep neural network based on Long Short Term Memory recurrent networks is used. The results of the three approaches are obtained with a real dataset extracted from the CDRs (Call Detail Records) in Milan city, Italy. It is shown that Q learning needs long convergence times to succeed to approach the ILP optimal results. Also, we demonstrate that deep neural network techniques learn much faster and mimic the ILP with very high scores.