文章基本信息

标题：COMBINING DECISION TREE AND BACK PROPAGATION GENETIC ALGORITHM NEURAL NETWORK FOR RECOGNIZING WORD GESTURES IN INDONESIAN SIGN LANGUAGE USING KINECT
本地全文：下载
作者：WIJAYANTI NURUL KHOTIMAH ; YOHANES ADITYA SUSANTO ; NANIK SUCIATI 等
期刊名称：Journal of Theoretical and Applied Information Technology
印刷版ISSN：1992-8645
电子版ISSN：1817-3195
出版年度：2017
卷号：95
期号：2
出版社：Journal of Theoretical and Applied
摘要：Sign language is a media for speech and/or hearing problems people to communicate. Different kind of sign languages exist in the world such as Indonesian Sign Language (ISL), American Sign Language (ASL), Chinese Sign Language (CSL), British Sign Language (BSL), Brazilian Sign Language (BSL), and France Sign Language (FSL). In Indonesia, the used of ISL was less extensive because not all people understand it. People that do not have understanding on ISL cannot translate it. Therefore an ISL translation system is required. Many researches about sign language translation system had been done for FSL, BSL, FSL, and CSL. However, research on ISL is still limited and still need development. Therefore we proposed a new system for recognizing ISL word gestures. In this research we captured user skeleton by using Kinect. From those skeletons only nine skeletons were used as feature by computing their vector value, angle value, and distance value. Totally 28 features were extracted. Then the combination of Decision Tree and Back Propagation Neural Network (BPGANN) was implemented for classifier. For experiment, eight ISL vocabularies were tested by two people. The recognition accuracy of this system, although evaluated with small vocabulary, presents very promising result with value 96%.
关键词：Indonesian Sign Language Recognition; Decision Tree; BPGANN; Kinect