文章基本信息

标题：A Tutor for the Hearing Impaired (Developed Using Automatic Gesture Recognition)
本地全文：下载
作者：Ila Agarwal ; Swati Johar ; Jayashree Santhosh 等
期刊名称：International Journal of Computer Science, Engineering and Applications (IJCSEA)
印刷版ISSN：2231-0088
电子版ISSN：2230-9616
出版年度：2011
卷号：1
期号：4
出版社：Academy & Industry Research Collaboration Center (AIRCC)
摘要：Automatic gesture recognition could be used to provide feedback in a computer-based learning environment to practice sign language skills for the deaf. In the present work the gestures made by the deaf as a communication aid, as per the Indian Sign Language were captured and a method was evolved to recognize them as English alphabets. After segmenting and removing the noise, the gestures were recognized in two stages. In the first stage, a common feature vector was calculated for all the alphabets, which captured the properties of overall shape of the gesture. If the gesture passed the first stage, then in the second stage a feature vector was calculated for that part of the gesture that actually represented the alphabet. The approach was evaluated by training the module on data of five users and testing on data of another five users. The dataset was characterized by varied user characteristics including clothing and skin tones. The module is user-independent and could be used for education as well as for entertainment purposes.
关键词：Gesture Recognition; Hearing Impaired; Indian Sign Language (ISL); Color Segmentation; Shape;Descriptors