Gyaanmudra: An AI Crafted Regional Sign Language App for Deaf and Mute

Abstract

GyaanMudra is an AI App for the regional sign language –Learning & communicating – The App is designed for deaf and mute people exclusively for educational uses. However, existing systems of sign language learning lack in the current aspect as they do not support regional languages, and do not modify as they are mainly using ASL (American Sign Language) in most of the systems, thereby limiting user accessibility and efficiency in India. These gaps cause difficulty in communications and deaf and mute people find it difficult receiving education, as well as challenging participation in their respective homes and communities. These challenges are faced by GyaanMudra using modern technology such as ML, DL and NLP to develop an integrated region-specific learning experience. GyaanMudra is unlike any known systems that provide real time communication capability, flexible learning modules with gesture recognition, and a high degree of user engagement and learning outcomes. Compared to other tools, GyaanMudra is more precise and is capable of running faster time changes at 75% more effectiveness as an alternative for educating sign language. The app is good at communication and also promotes social inclusiveness, it supports active participation of user in social and educational environments. Achievements will aim to improve regional language support and the additional AI capability.