Performing an overview of the benchmarking initiatives oriented towards the performance evaluation of Holonic Manufacturing Systems shows that there are very few of them. However, a comparison between all the isolated emu-lation developments for benchmarking in literature was made, and showed that many common features could be extracted. Several deadlocks for a generic approach of these developments are also exhibited. A global architecture dedicated to a generic performance evaluation platform design is suggested. This architecture integrates a scenario manager, whose main specificities were detailed and justified. Those features are meant to both integrate the best practices encountered in literature and fulfil the missing aspects to respond to the problematics.