Recognizing Filipino sign language video sequences using deep learning techniques

Clicks: 2
ID: 286017
2023
Free PDF
Article Quality & Performance Metrics
Overall Quality
Not rated
Combines reader engagement with the AI quality analysis. This article has not been analysed, so there is no overall score — reader engagement is measured and shown alongside.
AI Quality Assessment
Not analyzed
Readership in this journal
Steady

Ranked #1,608 of 3,757 articles by views in Malay Journal

Most read Least read

Bar heights use a square-root scale. Only the 120 most-read articles are drawn; the journal has 3,757 in total.

Mint this article as an NFT
Not yet minted

Create a permanent, verifiable on-chain record of this article on the Scimatic Network. The NFT is held in your Journament account, and you can withdraw it to your own wallet at any time.

5 SUSD one-off · no wallet required
Sign in to mint
Abstract
The use of machine intelligence for sign language is a popular method, especially in the field of sign language recognition. A model that performs well on SLR can bridge the gap between the deaf and the hearing. Furthermore, it can be applied to a great number of applications such as sign language education. The overarching issue in this field is the chronic lack of high-quality and large-volume datasets. This holds back SLR research, especially on less studied sign languages such as FSL. In addition, the inclusion of real-world applications is rare in FSL research. With this in mind, the study focused on creating a high-quality FSL dataset, building an accurate model, as well as developing an application to deal with the current gaps in FSL research. A dataset of more than 2000 video clips with 105 different signs was made. The signs were carefully chosen by an expert to make sure that these are useful introductory signs. Each frame of the video contains joint locations which were extracted by MediaPipe. Graph convolutional networks and Gated Recurrent Networks were then used to classify the signs. Using the model, an FSL E-learning desktop app was then developed. The top model, MediaPipe-GRU, was able to achieve a 100% top-5 accuracy on the dataset.
Reference Key
persistent_1760657327_68f17fafb16ed Use this key to autocite in the manuscript while using SciMatic Manuscript Manager or Thesis Manager
Authors Tupal, Isaiah Jassen L.
Journal Malay Journal
Year 2023
DOI
DOI not found
URL
https://animorepository.dlsu.edu.ph/etdm_ece/25
Keywords Keywords not found

Citations

No citations found. To add a citation, contact the admin at info@scimatic.org

Comments

No comments yet. Be the first to comment on this article.