A Representation Language for Multimedia Web Semantic
Résumé
While the extraction of low level multimedia features has been largely studied, the automatic extraction of high level descriptions is still an open research field. More- over, as semantic web languages, which are based on De- scription Logics, are conceived for describing all kinds of resources, specific extensions of semantic languages for describing multimedia resources are needed. Descriptors offering enough expressivity to represent spatio-temporal constraints are the major needed tools to describe video high level features. Such descriptors should allow to bridge the different semantic levels of descriptions and to narrow the semantic gap. In this paper we present a generic lan- guage for the representation and the description of multi- media contents. Based on Finite Automata and Conceptual Graphs, this formalism allows to express spatial and tempo- ral constraints, as to define sequences of events in a video and positions of objects in an image. In addition to the description of complex concepts, this formalism allows to monitor behaviors in a video-surveillance context, to detect important highlights in a sport context and also to validate MPEG7-based descriptions.