HandGest: hierarchical sensing for robust-in-the-Air handwriting recognition with commodity wifi devices - Archive ouverte HAL
Article Dans Une Revue IEEE Internet of Things Journal Année : 2022

HandGest: hierarchical sensing for robust-in-the-Air handwriting recognition with commodity wifi devices

Jie Zhang
Yang Li
Haoyi Xiong
Dejing Dou

Résumé

Recent advances in wireless sensing techniques have made it possible to recognize hand gestures using channel state information (CSI) in commodity WiFi devices. Existing WiFibased gesture recognition systems mainly use learning-based pattern recognition methods to recognize different gestures, however, these methods fail to work well when the locations of transceivers, the relative location and orientation of the hand with respect to transceivers, and/or the hand gesturing size change, leading to inconsistent signal patterns caused by those factors. Although some recent efforts have been made to address the so-called "domain-dependent" gesture recognition problem, they either require prior knowledge on initial locations of the hand and WiFi devices or need to train several classifiers for the specific domains. Different from the state-of-the-art methods, we construct two distinct features from a hand-oriented view (rather than from a transceiver's view), namely, the dynamic phase vector (DPV) and motion rotation variable (MRV), which are quite consistent in characterizing a big set of handwriting gestures, despite significant change in locations of transceivers, the relative location and orientation of the hand with respect to transceivers, and the drawing sizes. We further incorporate a hierarchical sensing framework and develop HandGest-a real-time handwriting gesture recognition system using commodity WiFi devices, to precisely recognize a great number of "in-the-air" handwritings based on the aforementioned two Manuscript

Dates et versions

hal-03959901 , version 1 (08-02-2024)

Identifiants

Citer

Jie Zhang, Yang Li, Haoyi Xiong, Dejing Dou, Chunyan Miao, et al.. HandGest: hierarchical sensing for robust-in-the-Air handwriting recognition with commodity wifi devices. IEEE Internet of Things Journal, 2022, 9 (19), pp.19529 - 19544. ⟨10.1109/JIOT.2022.3170157⟩. ⟨hal-03959901⟩
16 Consultations
1 Téléchargements

Altmetric

Partager

More