Towards Accessible Sign Language Learning and Assessment
| Type of publication: | Conference paper |
| Citation: | Tarigopula_ICMI_2022 |
| Publication status: | Published |
| Booktitle: | ACM International Conference on Multimodal Interaction |
| Year: | 2022 |
| Month: | November |
| Pages: | 626-631 |
| Location: | Bangalore, INDIA |
| ISBN: | 978-1-4503-9390-4 |
| DOI: | https://doi.org/10.1145/3536221.3556623 |
| Abstract: | Recently, a phonology-based sign language assessment approach has been proposed using sign language production acquired in 3D space using Kinect sensor. In order to scale the sign language assessment system to realistic application, there is need to reduce the dependency on Kinect, which is not accessible to wider community, and develop solutions that can potentially work with web-cameras. This paper takes a step in that direction by investigating sign language recognition and sign language assessment in 2D space either by dropping the depth coordinate in Kinect or using methods for skeleton estimation from videos. Experimental studies on Swiss German Sign Language corpus SMILE show that, while loss of depth information leads to considerable drop in sign language recognition performance, high level of sign language assessment performance can still be obtained. |
| Keywords: | hidden Markov models, human skeleton estimation, sign language assessment, Sign language processing |
| Projects |
Idiap SMILE |
| Authors | |
| Added by: | [UNK] |
| Total mark: | 0 |
|
Attachments
|
|
|
|
|
Notes
|
|
|
|
|
