This paper proposes an adaptive bit allocation scheme by using a fully connected (FC) deep neural network (DNN) considering imperfect channel state information (CSI) for heterogeneous networks. Achieving an accurate CSI has a crucial role on the system performance of the heterogeneous networks. Different quantization techniques have been employed to reduce the feedback overhead. However, the system performance cannot increase linearly with the number of bits increasing exponentially. Since optimizing the total number of bits is too complex for the entire network, an initial step is performed to distribute the bits to each cell in the conventional method. Then, the distributed bits are further allocated to each channel optimally. In order to enable direct allocation for the entire network, a FC-DNN based method is presented in this study. The optimized number of bits can be directly obtained for a different number of bits and scenarios by the proposed approach. The simulations are performed by using various scenarios with different allocation schemes. The performance results show that the DNN based method achieves a closer performance to the conventional approach.