文章基本信息

标题：A STUDY ON DYNAMIC HAND GESTURE RECOGNITION FOR FINGER DISABILITY USING MULTI-LAYER NEURAL NETWORK
本地全文：下载
作者：ROMI FADILLAH RAHMAT ; SARAH PURNAMAWATI ; EKA PRATIWI GOENFI 等
期刊名称：Journal of Theoretical and Applied Information Technology
印刷版ISSN：1992-8645
电子版ISSN：1817-3195
出版年度：2018
卷号：96
期号：11
出版社：Journal of Theoretical and Applied
摘要：Interaction between human and computer is generally performed with a keyboard and mouse. However, these interactions have certain drawbacks which cannot be done by users with physical disabilities or user who have disability from the wrist to the fingertip. To overcome this problem, an approach to recognize human hand gesture as a means of human-computer interaction is needed. The method proposed by the author is the use of algorithms: nearest neighbor, grayscaling, frame-differencing, Principal Component Analysis (PCA) and Multi-Layer Perceptron (MLP). This research was conducted in two experiments, which were experiment with six different types of hand gestures and experiments with four different types of hand gestures. Each experiment was performed five times with different value of number of hidden layers parameter and hidden neurons parameter. The best testing result obtained from the experiment with six types of hand gestures is from the second experiment with two hidden layers using 300 and 50 hidden neurons for each layer, resulting in an accuracy rate of 77.02%. The best testing result obtained from the experiment with four different types of hand gestures is from the first experiment with two hidden layers using 300 and 50 hidden neurons for each layer, resulting in an accuracy rate of 89.72%. The best overall result is then implemented into the front-end system for controlling application such as: file explorer, music player, video player, slideshows and PDF reader.
关键词：Dynamic Hand Gesture; Multilayer Perceptron; Finger Disability; Image Processing