Hap2Gest: An Eyes-Free Interaction Concept with Smartphones Using Gestures and Haptic Feedback - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

Hap2Gest: An Eyes-Free Interaction Concept with Smartphones Using Gestures and Haptic Feedback

Résumé

Smartphones are used in different contexts, including scenarios where visual and auditory modalities are limited (e.g., walking or driving). In this context, we introduce a new interaction concept, called Hap2Gest, that can give commands and retrieve information, both eyes-free. First, it uses a gesture as input for command invocation, and then output information is retrieved using haptic feedback perceived through an output gesture drawn by the user. We conducted an elicitation study with 12 participants to determine users’ preferences for the aforementioned gestures and the vibration patterns for 25 referents. Our findings indicate that users tend to use the same gesture for input and output, and there is a clear relationship between the type of gestures and vibration patterns users suggest and the type of output information. We show that the gesture’s speed profile agreement rate is significantly higher than the gesture’s shape agreement rate, and it can be used by the recognizer when the gesture shape agreement rate is low. Finally, we present a complete set of user-defined gestures and vibration patterns and address the gesture recognition problem.
Fichier principal
Vignette du fichier
Interact_2023_full_paper___Hap2Gest__An_Eyes_free_Interaction_Technique_with_Smartphones_Using_Gestures_and_Haptic_Feedback (3).pdf (2.18 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04204265 , version 1 (19-09-2023)

Identifiants

Citer

Milad Jamalzadeh, Yosra Rekik, Alexandru Dancu, Laurent Grisoni. Hap2Gest: An Eyes-Free Interaction Concept with Smartphones Using Gestures and Haptic Feedback. 19th IFIP TC13 International Conference, York, UK, August 28 – September 1, 2023, Aug 2023, York, United Kingdom. pp.479-500, ⟨10.1007/978-3-031-42280-5_31⟩. ⟨hal-04204265⟩
53 Consultations
92 Téléchargements

Altmetric

Partager

More