0% found this document useful (0 votes)
22 views16 pages

Rendon

The document reviews literature related to sign language recognition techniques. It summarizes that current methods require conceptual classification to correctly interpret data, and that multimodal recognition combining vision and sensor data outperforms unimodal analysis. While models have improved translation of continuous sign language, none currently have broad enough generalization for commercial use. However, the fast pace of research suggests further progress is likely if specific challenges are addressed.

Uploaded by

mememew suppasit
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
22 views16 pages

Rendon

The document reviews literature related to sign language recognition techniques. It summarizes that current methods require conceptual classification to correctly interpret data, and that multimodal recognition combining vision and sensor data outperforms unimodal analysis. While models have improved translation of continuous sign language, none currently have broad enough generalization for commercial use. However, the fast pace of research suggests further progress is likely if specific challenges are addressed.

Uploaded by

mememew suppasit
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

Review of Related Literature

Area/ Field/ Variable/ Indicator/ Theme/ Context Author/s Year Reference Citation Information/ Data/ Statistics In-Text Citation
Sign Language Learning Resources Muhamm 202 Author/s: Hearing impairments The creation of
ad Al- 1 Muhammad Al- worldwide necessitate the efficient local
Qurishi, Qurishi, Thariq development of effective level sign
Thariq Kalid, Riad Soussi local level sign language language
Kalid, Date: 07 recognition tools. A review of identification
Riad Septemper 2021 automated sign language technologies is
Soussi Research Title: recognition methods necessary due
Deep Learning for published between 2014 and to the
Sign Language 2021 found that current widespread
Recognition: methods require conceptual prevalence of
Current classification to interpret data hearing loss.
Techniques, correctly. The paper According to a
Benchmarks, and discusses common elements survey of
Open Issues in sign language recognition automated sign
Journal Title: IEEE methodologies and proposes language
Access a general framework for recognition
Volume Number: 9 researchers. It emphasizes techniques
Issue Number: the importance of input produced
Page/s: 126917- modalities, with recognition between 2014
126951 based on a combination of and 2021, the
DOI/ URL: data sources, including proper
[Link] vision-based and sensor- interpretation of
10.1109/ based channels, being data is still
ACCESS.2021.311 superior to unimodal required by the
0912 analysis. Recent advances present
Reference Citation: have allowed researchers to systems. The
Al-Qurishi, M., translate continuoussign study presents
Khalid, T., Souissi, language communicationwith a broad
R. (2021).Deep minimal delay. While many framework for
Learning for Sign models are effectivefor academics and
Language various tasks, none currently examines
Techniques, possess the generalization common
Benchmarks, and potential for commercial components in
Open Issues, in deployment. However, the sign language
IEEE Access, 9, pace of research is recognition
126917-126951 encouraging,and further approaches.
progress is expected if The importance
specific difficulties are of input
resolved. modalities is
emphasized,
with multimodal
recognition
outperforming
unimodal
analysis in
many cases.
Examples of
such
multimodal
recognition
include vision-
based and
sensor-based
channels.
Recent
developments
have made it
possible for
academics to
quickly
translate
continuous sign
language
conversation.
Although there
are several
models that
work well for
different tasks,
none of them
are yet generic
enough to be
used in
commerce.
However, the
rate of research
is encouraging,
and if particular
challenges are
overcome,
more
advancement is
anticipated.
Other sign language games Bowen 202 Author/s: We study the task of sign This research
Shi, D. 1 Bowen Shi, D. language fingerspelling focuses on the
Brentari, Brentari, G. detection, motivated by the identification of
G. Shakhnarovich, goal of developing it as an sign language
Shakhna Karen Livescu upstream component in an fingerspelling,
rovich, Date: automatic recognition driven by the
Karen 2021 system. We propose a objective of
Livescu Research Title: benchmark, based on incorporating it
Fingerspelling extending a previously into an
detection in released fingerspelling automated
American Sign recognition dataset, and recognition
Language establish a suite of metrics to system. We
Journal Title: evaluate detection models introduce a
Conference on both on their own merits and benchmark by
Computer Vision on their contribution to expanding an
and Pattern downstream recognition. existing
Recognition fingerspelling
DOI/URL: recognition
DOI:10.1109/CVP dataset and
R46437.2021.0041 create a set of
5 criteria for
Volume Number: assessing
detection
Issue Number: models,
considering
Page/s: their individual
performance
DOI/URL: and their impact
[Link] on subsequent
109/CVPR46437.2 recognition
021.00415 tasks (Shi et
Reference Citation: al.,2021).
Shi, B., Brentari,
D., Shakhnarovich,
G., Livescu, K.
(2021).
Fingerspelling
detection in
American Sign
Language.
Conference on
Computer Vision
and Pattern
Recognition.
[Link]
109/CVPR46437.2
021.00415
About American Sign Language Scott K. 202 Author/s: The majority of deaf people The majority of
Liddell 1 Scott K Liddell in the United States deaf people in
Date: communicate with American the United
Sign Language (ASL). ASL is States
Research Title: separate from sign systems communicate
American Sign that make an effort to with American
Language Syntax manually create English. Sign Language
There are various sign (ASL). ASL is
Journal Title: systems that mimic English, separate from
Walter de Gruyter and they differ in how sign systems
GmbH & Co KG accurately they do it. that make an
Volume Number: effort to
manually create
Issue Number: English. There
are various sign
Page/s: systems that
mimic English,
DOI/ URL: and they differ
https:// in how
[Link] accurately they
m/scholar? do it. Simply
hl=en&as_sdt=0% placing the
2C5&q=american+ signs in the
sign+language&oq exact sequence
=america#d=gs_qa they would
bs&t=1696824034 appear in the
337&u=%23p English
%3D2sRojSrQgOE sentence being
J signed is one of
the least
Reference Citation: accurate ways
Liddell, S.K. to “sign” the
(2021). language.
American Sign (Liddell, 2021)
Language Syntax.
Walter de Gruyter
GmbH & Co KG.
https://
[Link]
m/scholar?
hl=en&as_sdt=0%
2C5&q=american+
sign+language&oq
=america#d=gs_qa
bs&t=1696824034
337&u=%23p
%3D2sRojSrQgOE
J
Origin of American Sign Language NIDCD( 201 Author/s: No person or committee ASL, a sign
National 9 NIDCD(National invented ASL. The exact language,
Institute Institute on beginnings of ASL are not originated over
on Deafness and clear, but some suggest that 200 years ago
Deafnes Other it arose more than 200 years from the
s and Communication ago from the intermixing of intermixing of
Other Disorders) local sign languages and local sign
Commun Date: March 2019 French Sign Language (LSF, languages and
ication Research Title: or Langue des Signes French Sign
Disorder What is American Française). Today’s ASL Language
s) Sign Language includes some elements of (LSF). Today’s
(ASL) LSF plus the original local ASL includes
Journal Title: sign languages; elements of
Volume Number: over time, these have LSF and
Issue Number: melded and changed into a original local
Page/s: rich, complex, and mature sign languages,
DOI/ URL: language. Modern ASL and but they are
https:// modern distinct
[Link] LSF are distinct languages. languages(NID
/sites/default/ While they still contain some CD, 2019).
files/Documents/ similar signs, they can no
health/hearing/ longer be understood by
american-sign- each other’s users.
[Link]
Reference citation:
National Institute
on Deafness and
Other
Communication
Disorders. (March,
2019). What is
American Sign
Language (ASL).
[Link]
[Link]/sites/defau
lt/files/Documents/
health/hearing/
american-sign-
[Link]
Advantages of learning sign language Alex 202 Author/s: Learning sign language has Being able to
Shaw, 3 Alex Shaw,
many advantages ranging interact with the
Burkhard Burkhard C
from being able to millions of
C Wünsche, Kevin
communicate with millions of people who are
Wünsche Mariono, Aiden
hearing impaired people, to deaf and hard
, Kevin Ranveer, Manhui improving cognitive function of hearing is
Mariono, Xiao, Ryo Hajika, and communication skills. only one benefit
Aiden Yitong Liu Sign language is recognised of learning sign
Ranveer, Date: as an official language in 74 language.
Manhui 2023 countries, including Others include
Xiao, Germany, Japan, and the improved
Ryo Research Title: UK. Despite that only a small cognitive
Hajika, JengASL: A percentage of people attempt function and
Yitong Gamified Approach to learn sign language. communication
Liu to Sign Language abilities. In 74
Learning in VR nations,
including
Journal Title: Germany,
Journal of WSCG Japan, and the
Volume Number: UK, sign
31 language is
Issue Number: recognized as
an official
Page/s: language.
Nevertheless,
DOI/ URL: only a small
https:// proportion of
[Link]/ people make an
10.24132/ effort to learn
JWSCG.2023.4 sign language.
(Shaw et al.,
Reference citation: 2023)
Shaw, A.,
Wünsche, B. C.,
Mariono, K.,
Ranveer, A., Xiao,
M., Hajika, R., Liu,
Y., (2023).
JengASL: A
Gamified Approach
to Sign Language
Learning in VR.
Journal of WSCG.
31.
Other sign language games Fadhlina 201 Author/s: i-Sign is developed in order i-Sign is an
Izzah 9 Fadhlina Izzah to provide help and act as an alternative
Sama, Saman, Nor Fahira alternative learning material learning tool
Nor Mdh Shariff, Nor for children with hearing loss. designed for
Fahira Intan Shafini It consists of two modules children with
Mhd Nasaruddin which are learning and quiz hearing loss,
Shariff, where the quiz section is consisting of
Nor Intan Date: separated from the learning two modules:
Shafini 26 December 2019 part. Therefore, the user can learning and
Nasarud focus on one module before quiz, allowing
din Research Title: they move to another. The users to focus
i-sign Language user can repeat the learning on one module
Application Via process until they understand before moving
Gamification the content and then move on to the quiz to
on To the quiz module to test test their
Journal Title: their understanding on what understanding.
Asian Journal of they have learned in the (Sama et al.,
University learning 2019).
Education

Volume Number:

Issue Number:

Page/s:197

DOI/ URL:
10.24191/ajue.v15i
3.7569
Reference citation:
Saman, F. I.,
Shariff, N. F. M.,
Nasaruddin, N. I.
S. (2019). I-sign
Language
Application Via
Gamification.
Asian Journal of
University
Education.
[Link]
4191/ajue.v15i3.75
69
Sign language translator Karan 202 Author/s: The initiative’s primary goal The main aim
Kumar 3 Karan Kumar Giri, is to improve the deaf of this initiative
Giri, Abhishek Singh, community’s ability to is to enhance
Abhishek Mohammad Intiyaj engage and communicate the deaf
Singh, Alam, Basanta with others around them. The community’s
Mohamm Mahato intention is to transform the capacity to
ad Intiyaj 26 basic characters that interact and
Alam, Date: make up the English connect with
Basanta 2023 alphabet. Script them, then people in their
Mahato Research Title: show them on a smartphone. vicinity. The
The Importance objective is to
and Challenges of convert the 26
Sign Language fundamental
Translator characters
comprising the
Journal Title: English
Spectrum of alphabet into
Emerging script and
Sciences display them on
Volume Number: a smartphone
3 (Giri et al.,
Issue Number: 2023).
1
Page/s:
36-38
DOI/ URL:
[Link]
10.55878/
SES2023-3-1-8
Reference citation:
Giri, K. K., Singh,
A., Alam, M. I.,
Mahato, B. (2023).
The Importance
and Challenges of
Sign Language
Translator.
Spectrum of
Emerging
Sciences, 3(1), 36-
38.
[Link]
5878/SES2023-3-
1-8

Gamified approach to language learning Yaccob, 202 Author/s: Modern trends lead to Digital and
Nur 2 Yaccob, Nur innovative technologies in gamified
Syafiqah Syafiqah; Rahman, education, including the birth learning, also
; Siti Fatimah Abd.; of digital and gamified known as
Rahman, Mohamad, learning or gamification. In gamification,
Siti Syamsul Nor English language was created
Fatimah Azlan; Rahim, classrooms, meaningful thanks to
Abd.; Azwin Arif Abdul; teaching and learning are contemporary
Mohama Rashid, Khadijah significant to developing trends in
d, Khalilah Abdul; students’ English proficiency, education.
Syamsul Aldaba, focusing on linguistics and Meaningful
Nor Abdulmajid communicative competence. teaching and
Azlan; Mohammed Various language activities learning, with a
Rahim, Abdulwahab; and games are employed in focus on
Azwin Yunus, Melor Md; lessons to instill anticipation linguistics and
Arif Hashim, Harwati for language learning. communicative
Abdul; ability, are
Rashid, Date: important to
Khadijah July 2022 growing
Khalilah students’
Abdul; Research Title: English
Aldaba, Gamifying ESL proficiency in
Abdulmaj Classrooms English
id through Gamified language
Mohamm Teaching and schools. To
ed Learning create
Abdulwa excitement for
hab; Journal Title: language
Yunus, Arab World learning, many
Melor English Journal language
Md; (AWEJ) activities and
Hashim, games are
Harwati Volume Number: used in
lessons.
(Yaccob et al.,
Issue Number: 2022)

Page/s:
177-191

DOI/ URL:
[Link]
10.24093/awej/
call8.12

Reference citation:
Yaccob, N. S.,
Rahman, S. F. A.,
Mohamad, S. N.
A., Rahim, A. A.
A., Rashid, K. K.
A., Aldaba, A. M.
A., Yunus, M. M.,
& Hashim, H.
(2022). Gamifying
ESL Classrooms
through
Gamified Teaching
and Learning .
Arab World
English Journal
(AWEJ), Special
Issue on CALL
(8), 177-191.
[Link]
0.24093/awej/call8.
12

Filipino sign language recognition system Mark 202 Author/s: Sign Language Recognition This study used
Benedict 1 Mark Benedict D is a breakthrough for helping a convolutional
D Jarabese, Charlie deaf-mute people and has neural network
Jarabese S Marzan, Jenelyn been studied for many years. to create a real-
, Charlie Q Boado, Unfortunately, every time hand
S Rushaine Rica research has its own gesture
Marzan, Mae F Lopez, Lady limitation and are still unable detection
Jenelyn Grace B Ofiana, to be used commercially. In system for the
Q Kenneth John P this study, we developed a Filipino sign
Boado, Pilarca real-time Filipino sign language. 237
Rushain language hand gesture video clips
e Rica Date: recognition system based on totaling 20
Mae F 2021 Convolutional Neural different
Lopez, Network. A manually gestures made
Lady gathered dataset consists of up the dataset,
Grace B Research Title: 237 video clips with 20 which
Ofiana, Sign to speech different gestures. This underwent data
Kenneth convolutional dataset underwent data cleaning and
John P neural network- cleaning and augmentation augmentation
Pilarca based filipino sign using image pre-processing utilizing image
language hand techniques. The Inflated 3D pre-processing
gesture recognition convolutional neural network techniques. The
system was used to train the Filipino model was
sign language recognition trained using a
Journal Title: model. The experiments 3D
International considered retraining the convolutional
Symposium on pretrained model with top neural network
Computer Science layers and all layers. As a called Inflated.
and Intelligent result, the model retrained An imbalanced
Controls with all layers using dataset was
imbalanced dataset was used to retrain
Volume Number: shown to be more effective the model, and
15 and achieving accuracy up to it was
Issue Number: 95% over the model discovered to
3 retrained with top layers to be more
Page/s: classify different signs or accurate,
147-153 hand gestures. Using the achieving up to
DOI/ URL: Rapid Application 95% accuracy.
Doi: Development model, the The Rapid
10.1109/ISCSIC54 Filipino sign language Application
682.2021.00036. recognition application was Development
Reference citation: developed and assessed its technique was
Jarabese, M. B. D., usability by the target users. used to create
Marzan, C. S., With different parameters the Filipino sign
Boado, J. Q., used in the evaluation, the language
Lopez, R. R. M. application found to be recognition
F. , Ofiana, L. G. effective and efficient. application,
B. & Pilarca, K. J. which target
P. (2021). Sign to users evaluated
Speech and found to be
Convolutional successful and
Neural Network- efficient.
Based Filipino Sign ( Jarabese et
Language Hand al., 2021)
Gesture
Recognition
System.
International
Symposium on
Computer Science
and Intelligent
Controls (ISCSIC),
15(3), 147-153,
[Link]
109/ISCSIC54682.
2021.00036.

Sign language definition Razieh 202 Author/s: Sign Language is the Sign language
Rastgoo, 1 Razieh Rastgoo, dominant yet non-primary is a crucial
Kourosh Kourosh Kiani, form of communication communication
Kiani, Sergio Escalera, language used in the deaf tool for the deaf
Sergio Mohammad and hearing-impaired and hard of
Escalera, Sabokrou community. To make an easy hearing, serving
Mohamm Date: and mutual communication as a secondary
ad 2021 between the hearing- form of
Sabokro Research Title: impaired and the hearing communication.
u Sign Language communities, building a A strong
Production: a robust system capable of system for
Review translating the spoken translating
Journal Title: language into sign language spoken
Proceedings of the and vice versa is language into
IEEE/CVF fundamental. To this end, sign language
conference on sign language recognition and vice versa
computer vision and production are two is necessary for
and pattern necessary parts for making easy and
recognition such a two-way system. Sign mutual
language recognition and communication
Volume Number: production need to cope with between the
Issue Number: some critical challenges. In two groups.
Page/s: this survey, we review recent This requires
3451-3461 advances in Sign Language the generation
DOI/ URL: Production (SLP) and related and recognition
https:// areas using deep learning. of sign
[Link] This survey aims to briefly language,
m/scholar? summarize recent which must
hl=en&as_sdt=0% achievements in SLP, overcome three
2C5&as_ylo=2019 discussing their advantages, major
&q=sign+language limitations, and future obstacles.
&btnG=#d=gs_qab directions of research. Recent
s&t=16968560610 developments
26&u=%23p in deep
%3DLedJS3tNXq8 learning-based
J Sign Language
Production
Reference citation: (SLP) provide a
Rastgoo, R., Kiani, concise
K., Escalera, S., overview of
Sabokrou, M. these
(2021). developments,
Sign Language highlighting
Production: a their benefits,
Review. IEEE/CVF drawbacks, and
conference on potential
computer vision research routes
and pattern (Rastgoo et al.,
recognition. 3451- 2021).
3461.
[Link]
[Link]/scholar?
hl=en&as_sdt=0%
2C5&as_ylo=2019
&q=sign+language
&btnG=#d=gs_qab
s&t=16968560610
26&u=%23p
%3DLedJS3tNXq8
J
Author/s:
Date:
Research Title:
Journal Title:
Volume Number:
Issue Number:
Page/s:
DOI/ URL:
Reference citation:

You might also like