Previously, crowd simulation plays small part or probably ignored in virtual heritage. Architectures or artifacts bit more focused to be reconstructed into virtual environment. By inserting crowd into simulation of virtual heritage, it will give more impact and achieve higher realism level to the reconstructed site. Before inserting the crowd into virtual environment, a research needs to be done to manage the complex environment of virtual heritage and the crowd itself. This paper presents a framework with a vision to reduce the computation cost for rendering crowd simulation in virtual heritage environment while maintaining realisms of the scene. We first review the existing acceleration techniques applied on crowd rendering. Then we introduce a framework that will integrate acceleration techniques for crowd simulation in virtual heritage.