Communicate Beyond Measures: Learning Sign Language App
The aim of the project is to explore the ways in which technology can be used to support the Deaf Community. The goal of the application, ‘Communicate Beyond Measures’, is to teach sign language to users of various ages and hearing abilities. ‘Communicate Beyond Measures’ is developed for Android using one of the top multi-platform gaming environments, Unity, in conjunction with the Augmented Reality platform, Vuforia. This application uses video tutorials to demonstrate the signs, combined with mini-games to help improve and reinforce the user’s learning.
This project investigates the ways in which technology can support the Deaf Community – specifically how technology combined with Augmented Reality can help those who require assistance learning sign language. The application has been designed and developed to teach sign language to children - though it is also suitable for users of various ages - through Augmented Reality and videos. ‘Communicate Beyond Measures’ is built for Android using one of the top multi-platform gaming environments, Unity. The application itself is coded in Visual Studio using C#. The Augmented Reality is implemented into Unity by a Vuforia plugin. The application uses video tutorials to demonstrate the signs combined with mini-games to help improve and reinforce the user’s learning.
The results of the tests were generally positive. Based on the feedback received, the application was easy to use for all ages. The tutorials for the signs were clear and understandable, and the mini-games were helpful for users to help remember the signs that they had learned. However some changes were made due to younger users having difficulty understanding the questions that were asked. The general consensus was that this application would be useful for those who need to learn sign language.