SISTEM PENGENALAN GERAK BAHASA ISYARAT DENGAN COLORED MOTION HISTORY IMAGE DAN CONVOLUTIONAL NEURAL NETWORK

• Main Author: Haiqal Ramanizar Al Fajri, (Author)
• Format: Book
• Published: 2022-07-06.
• Subjects: Thesis; NonPeerReviewed
• Online Access: Link Metadata
• Notes: http://repository.upnvj.ac.id/19673/19/ABSTRAK.pdf; http://repository.upnvj.ac.id/19673/20/AWAL.pdf; http://repository.upnvj.ac.id/19673/28/BAB%201.pdf; http://repository.upnvj.ac.id/19673/30/BAB%202.pdf; http://repository.upnvj.ac.id/19673/12/BAB%203.pdf; http://repository.upnvj.ac.id/19673/13/BAB%204.pdf; http://repository.upnvj.ac.id/19673/14/BAB%205.pdf; http://repository.upnvj.ac.id/19673/8/DAFTAR%20PUSTAKA.pdf; http://repository.upnvj.ac.id/19673/17/RIWAYAT%20HIDUP.pdf; http://repository.upnvj.ac.id/19673/24/LAMPIRAN.pdf; http://repository.upnvj.ac.id/19673/15/HASIL%20PLAGIARISME.pdf; http://repository.upnvj.ac.id/19673/23/ARTIKEL%20KI.pdf
• Keywords: Q Science (General); QA Mathematics; QA75 Electronic computers. Computer science; T Technology (General)

This research was conducted to create a sign language recognition system that can be used to recognize sign language movements in the Indonesian Sign Language (BISINDO) system. Sign language is a method of communicating for deaf people to understand the meaning and information received and convey desires and emotions using the help of hands, gestures, lips, and facial expressions. In this research, the author uses the Convolutional Neural Network (CNN) method to perform the motion recognition process. In addition, the author uses the Colored Motion History Image (Colored MHI) method to represent motion from video into one image. The Colored MHI method performs color changes made by the Motion History Image (MHI), which generally uses a grayscale into RGB color format. The data was obtained through video shooting by the author on 15 subjects with 5 movement classes and resulted in a total of 450 data. The video data that has been obtained is cropped and then converted into a single image using the Colored MHI method. The results of making the CNN model with training data are tested with test data that has passed the Colored MHI stage and its performance will be seen through its accuracy and loss values. The results of this research indicate that the CNN and Colored MHI methods can recognize sign language gestures quite well. The accuracy and loss obtained are 0.8533 and 0.4741.