From the mid 2000s, an increasing number of initiatives have explored the digitization of live performance collections. Generally these initiatives focus mainly on video recording, the most “spectacular” and easily approachable components of performance archives. Yet, it may seem simplistic to suggest the webcasting of video recordings, in whole or in part, in the midst of the possibilities offered by semantic web technologies and metadata. What are the benefits of digital technologies over the more conventional documentary method that has now become video recording? We will demonstrate how one answer lies in video recording annotation. Far from being univocal, video recording annotation has brought forward multiple approaches in the field of the performing arts. We will outline key experiments on the subject, including those led by William Forsythe, whose work has transformed video recordings from heritage materials to being a generator of digital arts, in the perspective of capturing choreography. Using Rekall software (currently under development), the goal is to expand the video annotation model to reach out to new visual possibilities of displaying the metadata underlying a heterogeneous corpus of documents associated with the same performance.