µGeT: Multimodal eyes-free text selection technique combining touch interaction and microgestures - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

µGeT: Multimodal eyes-free text selection technique combining touch interaction and microgestures

Résumé

We present μGeT, a novel multimodal eyes-free text selection technique. μGeT combines touch interaction with microgestures. μGeT is especially suited for People with Visual Impairments (PVI) by expanding the input bandwidth of touchscreen devices, thus shortening the interaction paths for routine tasks. To do so, μGeT extends touch interaction (left/right and up/down flicks) using two simple microgestures: thumb touching either the index or the middle finger. For text selection, the multimodal technique allows us to directly modify the positioning of the two selection handles and the granularity of text selection. Two user studies, one with 9 PVI and one with 8 blindfolded sighted people, compared μGeT with a baseline common technique (VoiceOver like on iPhone). Despite a large variability in performance, the two user studies showed that μGeT is globally faster and yields fewer errors than VoiceOver. A detailed analysis of the interaction trajectories highlights the different strategies adopted by the participants. Beyond text selection, this research shows the potential of combining touch interaction and microgestures for improving the accessibility of touchscreen devices for PVI.
Fichier principal
Vignette du fichier
Get.pdf (2.18 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04353214 , version 1 (19-12-2023)

Identifiants

Citer

Gauthier Robert Jean Faisandaz, Alix Goguey, Christophe Jouffrais, Laurence Nigay. µGeT: Multimodal eyes-free text selection technique combining touch interaction and microgestures. 25th ACM International Conference on Multimodal Interaction Paris (ICMI 2023), ACM Special Interest Group on Computer-Human Interaction, Oct 2023, Paris, France. pp.594-603, ⟨10.1145/3577190.3614131⟩. ⟨hal-04353214⟩
51 Consultations
23 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More