3D Gesture-Based Interaction for Immersive Experience in Mobile VR
2016 (English)Conference paper (Refereed)
In this paper we introduce a novel solution for real-time 3D hand gesture analysis using the embedded 2D camera of a mobile device. The presented framework is based on forming a large database of hand gestures including the ground truth information of hand poses and details of finger joints in 3D. For a query frame captured by the mobile device's camera in real time, the gesture analysis system finds the best match from the database. Once the best match is found, the corresponding ground truth information will be used for interaction in the designed interface. The presented framework performs an extremely efficient gesture analysis (more than 30 fps) in flexible lighting condition and complex background with dynamic movement of the mobile device. The introduced work is implemented in Android and tested in Gear VR headset.
Place, publisher, year, edition, pages
Cancun, Mexico: IEEE Press, 2016. , 6 p.
Gesture and Behavior Analysis, Image and video analysis and understanding, Human Computer Interaction
Research subject Computer and Information Sciences Computer Science, Media Technology
IdentifiersURN: urn:nbn:se:lnu:diva-61447ISBN: 9781509048465 OAI: oai:DiVA.org:lnu-61447DiVA: diva2:1082554
23rd International Conference on Pattern Recognition (ICPR): Image Analysis and Machine Learning for Scene Understanding" Cancun, 4-8 December
Ej belagd 1703212017-03-162017-03-162017-03-21