The ISO MPEG-4 standard enhances the traditional concept of video sequence and proposes a synchronized set of visual objects organized in a flexible way. The video delivery according to this new paradigm results in a challenging new bit-allocation, and rate-control mechanisms, which has to satisfy complex application requirements. In this paper, we propose a rate control mechanism, which optimally selects the sending rate for each object constituting the video scene. This rate allocation is done in agreement with the particularity of the multi-object video coding schemes. Thus, in our proposal, we allocate more bandwidth to the object having the most impact on the video quality. To perform this optimal allocation, we use the dynamic programming approach to select the optimal amount of bandwidth to be allocated to each object. The obtained results show the importance of this consideration in multi-object video delivery. We demonstrate that the video quality can be significantly increased.