The increasingly low prices of virtual reality devices as well as omnidirectional cameras are stimulating the development of serious game applications using interactive 360 videos for the entertainment and training industries. While 360° video production is getting easier and faster, on the other hand, developing interactive content for scenarios of serious games remains time-consuming and manual, and requires a lot of programming knowledge. The lack of an interaction design standard based on a defined architecture can create misunderstandings between game designers and game developers, also making the development process costly and resource-intensive. As a case study, we present a new design approach dedicated to serious games developed based on interactive panoramic videos which have the special control requirements in both temporal and spatial terms. This design will be introduced as a finite state machine (FSM), suitable for developing multithreaded scenarios.