This research proposes a new architecture for the inter-connectivity between UEs running on the LTE infrastructure participating in an Application Layer Multicast-based distributed conference. The main contribution is that the proposal replaces the standard centralized architecture of the IMS-based conference with a more robust solution utilizing intelligence and computational capacity of LTE's eNodeBs. The costly Media Resource Function Controller (MRFC) can be fully omitted from the IMS without effecting the conference. A prototype has been built to prove the feasibility of the proposed architecture and evaluate its performances.