BioSecure Signature Evaluation Campaign (ESRA'2011) : evaluating systems on quality-based categories of skilled forgeries
Nesma Houmani
(1, 2, 3)
,
Sonia Garcia-Salicetti
(1, 2, 3)
,
Bernadette Dorizzi
(4, 1, 2, 3)
,
Jugurta Montalvão
(5)
,
Jânio C. Canuto
(5)
,
Mario V. Andrade
(6)
,
Yu Qiao
(7)
,
Xingxing Wang
(7)
,
Tobias Scheidat
(8)
,
Andrey Makrushin
(9)
,
Daigo Muramatsu
(10)
,
Joanna Putz-Leszczynska
(11)
,
Michal Kudelski
(11)
,
Marcos Faundez-Zanuy
(12)
,
Juan Manuel Pascual-Gaspar
(13)
,
Valentin Cardeñoso-Payo
(13)
,
Carlos Vivaracho-Pascual
(13)
,
Enrique Argones Rúa
(14)
,
José-Luis Alba-Castro
(14)
,
Alisher Kholmatov
(15)
,
Berrin Yanikoglu
(15)
1
TSP - EPH -
Département Electronique et Physique
2 SAMOVAR - Services répartis, Architectures, MOdélisation, Validation, Administration des Réseaux
3 CNRS - Centre National de la Recherche Scientifique
4 TIPIC-SAMOVAR - Traitement de l'Information Pour Images et Communications
5 DEL - Faculty of Electrical Engineering
6 TECNED - Tecnologias Educacionais (Tecnologias Educacionais Ltda)
7 SIAT - Shenzhen Institute of Advanced Technology [Shenzhen]
8 Department of Informatics and Media (University of Applied Sciences Brandenburg)
9 AMSL - Advanced Multimedia and Security Lab
10 Department of Electrical and Mechanical Engineering (Seikei University)
11 Warsaw University of Technology [Warsaw]
12 Escola Universitària Politècnica de Mataró
13 Department of Computer Science (University of Valladolid)
14 Universidade de Vigo
15 Sabanci University - Faculty of Engineering and Natural Sciences
2 SAMOVAR - Services répartis, Architectures, MOdélisation, Validation, Administration des Réseaux
3 CNRS - Centre National de la Recherche Scientifique
4 TIPIC-SAMOVAR - Traitement de l'Information Pour Images et Communications
5 DEL - Faculty of Electrical Engineering
6 TECNED - Tecnologias Educacionais (Tecnologias Educacionais Ltda)
7 SIAT - Shenzhen Institute of Advanced Technology [Shenzhen]
8 Department of Informatics and Media (University of Applied Sciences Brandenburg)
9 AMSL - Advanced Multimedia and Security Lab
10 Department of Electrical and Mechanical Engineering (Seikei University)
11 Warsaw University of Technology [Warsaw]
12 Escola Universitària Politècnica de Mataró
13 Department of Computer Science (University of Valladolid)
14 Universidade de Vigo
15 Sabanci University - Faculty of Engineering and Natural Sciences
Nesma Houmani
- Fonction : Auteur
- PersonId : 176654
- IdHAL : nesma-houmani
- ORCID : 0000-0002-5048-9313
Sonia Garcia-Salicetti
- Fonction : Auteur
- PersonId : 1013045
- IdHAL : sonia-garcia-salicetti
- ORCID : 0000-0001-5257-8216
- IdRef : 137430736
Bernadette Dorizzi
- Fonction : Auteur
- PersonId : 183872
- IdHAL : bernadette-dorizzi
- ORCID : 0000-0002-7502-1418
- IdRef : 076405176
Résumé
In this paper, we present the main results of the BioSecure Signature Evaluation Campaign (ESRA'2011). The objective of ESRA'2011 is to evaluate through two different tasks the resistance of different online signature systems to skilled forgeries categorized automatically according to their quality. Task 1 aims at studying with only coordinate time functions the influence of acquisition conditions (digitizing tablet vs. PDA) on systems' performance. The two BioSecure Data Sets DS2 and DS3 make this possible, since they contain data from the same 382 people, acquired respectively on a digitizer and on a PDA. Task 2 then aims at assessing the contribution of the five time functions available on a digitizer (coordinates, pressure, pen inclination) on systems' resistance to different qualities of skilled forgeries. Results of the 13 systems involved in this competition are reported and analyzed for both tasks in this paper. We observe that the best system in terms of performance on forgeries of "bad" quality is not necessarily the most resistant to an increased quality of skilled forgeries. Also, we note that mobile conditions are still threatening independently of the quality of forgeries. Finally, when adding pen inclination time functions to pressure and coordinates, we find that the gap between systems in terms of performance is wider than when only pen coordinates and pressure are considered