Two Hand Gesture Based 3D Navigation in Virtual Environments

TitleTwo Hand Gesture Based 3D Navigation in Virtual Environments
Publication TypeJournal Article
Year of PublicationIn Press
AuthorsRehman, I., S. Ullah, and M. Raees
JournalInternational Journal of Interactive Multimedia and Artificial Intelligence
IssueIn Press
VolumeIn Press
NumberIn Press
Date Published07/2018

Natural interaction is gaining popularity due to its simple, attractive, and realistic nature, which realizes direct Human Computer Interaction (HCI). In this paper, we presented a novel two hand gesture based interaction technique for 3 dimensional (3D) navigation in Virtual Environments (VEs). The system used computer vision techniques for the detection of hand gestures (colored thumbs) from real scene and performed different navigation (forward, backward, up, down, left, and right) tasks in the VE. The proposed technique also allow users to efficiently control speed during navigation. The proposed technique is implemented via a VE for experimental purposes. Forty (40) participants performed the experimental study. Experiments revealed that the proposed technique is feasible, easy to learn and use, having less cognitive load on users. Finally gesture recognition engines were used to assess the accuracy and performance of the proposed gestures. kNN achieved high accuracy rates (95.7%) as compared to SVM (95.3%). kNN also has high performance rates in terms of training time (3.16 secs) and prediction speed (6600 obs/sec) as compared to SVM with 6.40 secs and 2900 obs/sec.

Keywords3D Navigation, Augmented Reality, Gesture Recognition, HCI, Virtual Reality
ip_07_01.pdf2.26 MB