STTK-based Video Object Recognition - Archive ouverte HAL Access content directly
Conference Papers Year : 2010

STTK-based Video Object Recognition


In this paper, we extend our video object recognition system to multiclass object recognition context, dealing with unbalanced data sets and comparing our resuls to state-of-the-art methods. Our approach is based on a Spatio-Temporal data representation, a dedicated kernel design and statistical learning techniques for object recognition. From video tracks made of segmented object regions in the successive frames, we extract sets of spatio-temporally coherent SIFT-based features, called Spatio-Temporal Tubes. To compare these complex tube objects, we integrate a Spatio-Temporal Tube Kernel (STTK) function into a multi-class classification framework with balancing process for unequal classes. Our approach is successfully evaluated on episodes from “Buffy, the Vampire Slayer” TV series which have been used in other works targeting same objectives. Our method proved to be more robust than dictionary based, facial feature based and key-frame based approaches. Our method is also tested on a small car database and preliminary results for car identification task illustrate its generalization potential.
No file

Dates and versions

hal-00773037 , version 1 (11-01-2013)



Shuji Zhao, Frédéric Precioso, Matthieu Cord. STTK-based Video Object Recognition. ICIP 2010 - 17th IEEE International Conference on Image Processing, Sep 2010, Hong-Kong, Hong Kong SAR China. pp.3873-3876, ⟨10.1109/ICIP.2010.5651177⟩. ⟨hal-00773037⟩
77 View
0 Download



Gmail Facebook Twitter LinkedIn More