HAND MOTION TRACKING BASED ON GESTURE UNDERSTANDING Name

Transcription

HAND MOTION TRACKING BASED ON GESTURE UNDERSTANDING Name
HAND MOTION TRACKING BASED ON GESTURE UNDERSTANDING
USING LEAP GESTURE FOR VIRTUAL 3D BATIK GALLERY
Name
NRP
Supervisors
: Ayung Candra Padmasari
: 2211205208
:1. Moch. Hariadi, ST.,M.Sc.,Ph.D
2. Christyowidiasmoro, ST.,MT.
Abstract
Hand Motion Tracking based on Gesture Understanding using Leap gesture for Virtual 3D
Batik Gallery can be used for virtual interactive to repalce device of keyboard and mouse function to
purpose variations of media packaging, especially for providing information, how to distribute
information more quickly, to make an applications and documentation data.
This research was divided into three stages, they are including abaut proscess of design in
modelling 3D using Normal Mapps, gestures scenario using Finite State machine (FSM) for each
room in gallery, and design of gesture understanding with hand motion tracking using Leap Gesture
in Leap Motion Controller.
The results of this research has response obtained for Hand Motion Tracking in 3D Batik
Gallery become 4 concept of hand gesture understanding, they are Tap Gesture with GPU response
(16 mm /s 60 FPS) (10 mm / s 100 FPS)( 5 ms/ 200 FPS,) and CPU response (33 ms 30FPS ) and
(16 ms / 60 FPS). and then flyhand gesture for GPU response (16 mm /s ) (60 FPS10 mm / s ) (100
FPS5 m/s 200 FPS) and CPU response (33 ms/ 30FPS) (16 ms / 60 FPS) and then Trusther for GPU
response (16 mm /s, 60 FPS) ( 33mm / s100 FPS) (16 ms / 60 FPS) , and CPU response (33 ms 30
FPS) (10 ms/60 FPS )(33 ms/ 30 FPS) (5 ms /200 FPS) and for Hold hand gesture in CPU response
(33 ms/30 FPS) ( 66 ms /60 FPS) and GPU response (33 ms/30 FPS) (66 ms /60 FPS)
Key word : Hand motion tracking, Gesture understanding, Normal mapp, Virtual 3D batik
Gallery