We consider how the construction of multi-structured documents can require the definition of annotations vocabularies. Moreover, in a multi-users context, the growth of these vocabularies has to be controlled. Therefore, we propose using the trace of users activity to limit this growth and to document the vocabularies. For example, a user will be able to follow and annotate the use of a term from its creation to its last instance and in the context of the surrounding actions. From a broader point of view, this work is grounded on our Web based philological platform, DINAH, and is mainly motivated by our collaboration with a group of philosophers studying the handwritten manuscripts of Jean-Toussaint Desanti.