Leveraging Self-Attention Mechanism for Deep Learning in Hand-Gesture Recognition System

Haq, Muhamad Amirul and Huy, Le Nam Quoc and Ridlwan, Muhammad and Naila, Ishmatun (2024) Leveraging Self-Attention Mechanism for Deep Learning in Hand-Gesture Recognition System. E3S Web of Conferences, 500. 01009. ISSN 2267-1242

	PDF (Artikel Jurnal) - Published Version Download (3MB)
	PDF (Hasil Pengecekan Turnitin) Download (1MB)

Abstract

This research addresses the complex challenge of recognizing hand gestures irrespective of the user's body posture, a crucial issue in medical treatment for people with speech impairments and human-machine interfaces where precise gesture interpretation is vital. The aim is to engineer an advanced hand gesture recognition system, effective across various body positions and camera viewpoints. A novel flexible camera arrangement was employed, integrating a CNN-Transformer hybrid model, leveraging the strengths of Convolutional Neural Networks and the self-attention mechanism of Transformers. Developed using Python and the PyTorch deep learning framework, the system focuses on sophisticated image processing techniques. A thorough literature review on gesture recognition systems and multi-view analysis was conducted to inform the development. The system demonstrated exceptional accuracy in recognizing hand gestures in diverse body postures and from multiple camera perspectives, significantly outperforming existing methods. It marked a significant advancement in decoding complex gestures, a key aspect for medical applications and intricate human-machine is primarily interactions. This beneficial for people with speech impairments, rehabilitation, and in human-machine interfaces, poised to revolutionize patient care and enhance interaction with advanced machinery and computer systems.

Item Type:	Article
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science Q Science > QA Mathematics > QA76 Computer software
Divisions:	Artikel Website > Fakultas Teknik
Depositing User:	Muhamad Amirul Haq
Date Deposited:	18 Mar 2024 01:52
Last Modified:	18 Mar 2024 01:52
URI:	http://repository.um-surabaya.ac.id/id/eprint/9165

Actions (login required)

View Item