Clouds provide to users on‐demand access to large computing and storing resources and offer over on premise IT infrastructures many advantages in terms of cost, flexibility, and availability. However, this new paradigm still faces many challenges, and in this paper, we address the load balancing problem. Even though many approaches have been proposed to balance the load among the servers, most of them are too sensitive to the fluctuation in the clouds load and produce unstable systems. In this paper, we propose a new distributed load balancing algorithm, based on adaptive starvation threshold. It tries to balance the load between the servers while minimizing the response time of the cloud, maximizing the utilization rate of the servers, decreasing the overall migration cost, and maintaining the stability of the system. The performance of the proposed algorithm was compared to a well‐known load balancing algorithm, inspired from the honey bee behavior (HBB). The experimental results showed that the application of the proposed load balancing algorithm gives considerable performance gains and a significant reduction in number of migrations when compared to the performance of the HBB algorithm.