Sistem Klasifikasi Alfabet Bahasa Isyarat Indonesia Menggunakan CNN dengan MobileNetV2 berbasis Android

Authors

  • Reihan Saputra Universitas Islam Nahdlatul Ulama Jepara
  • Gentur Wahyu Nyipto Wibowo Universitas Islam Nahdlatul Ulama Jepara
  • Akhmad Khanif Zyen Universitas Islam Nahdlatul Ulama Jepara

DOI:

https://doi.org/10.5281/zenodo.14686025

Abstract

Communication is a basic human need, including for deaf and hard of hearing people who face difficulties in interacting using verbal language. One of the problems is the lack of optimal technology in supporting communication with Indonesian Sign Language (BISINDO) in real-time. This research aims to test the ability of MobileNetV2 in classifying the BISINDO alphabet as a technological solution that supports communication for the deaf and hard of hearing in real-time. This research dataset consists of 5200 BISINDO alphabet images (200 images per class) processed with data augmentation. The data is divided into 80% train data, 10% validation data, and 10% test data. Transfer learning was used to train the MobileNetV2 model with initial weights from ImageNet. The model is equipped with Global Average Pooling, Batch Normalization, and Dropout to improve performance. Training used Adam's optimizer with a learning rate of 1e-4. Evaluation resulted in validation accuracy of 95% and testing accuracy of 93.85%. The model is converted to TensorFlow Lite for use in Android applications, so that BISINDO alphabet classification can be done in real-time through the camera. This application is expected to be a solution for people who face difficulties in communicating with the deaf and speech impaired.

 

Keywords Convolutional Neural Network (CNN), MobileNetV2, Sign Language

Downloads

Download data is not yet available.

Author Biography

Gentur Wahyu Nyipto Wibowo, Universitas Islam Nahdlatul Ulama Jepara

Kaprodi Teknik Informatika, Fakultas Sains dan Teknologi, Universitas Islam Nahdlatul Ulama Jepara

Downloads

Published

2025-01-18

How to Cite

Reihan Saputra, Gentur Wahyu Nyipto Wibowo, S.Kom. M.Kom., & Akhmad Khanif Zyen, S.Kom. M.Kom. (2025). Sistem Klasifikasi Alfabet Bahasa Isyarat Indonesia Menggunakan CNN dengan MobileNetV2 berbasis Android. JUPITER: Jurnal Penelitian Ilmu Dan Teknologi Komputer, 17(1), 237–248. https://doi.org/10.5281/zenodo.14686025