Gesture and voice-based personal computer control system

Abstract

The rapid advancement of human-computer interaction technologies has led to the development of more intuitive and accessible control systems. This project introduces a gesture and voice-based control system that enables users to interact with their computers using hand gestures and voice commands, enhancing convenience in situations where traditional input methods are impractical. It utilizes Media Pipe Hands for real-time gesture recognition via a webcam and Speech Recognition in Python for processing voice commands, mapping them to actions such as opening applications, adjusting volume, taking screenshots, and closing programs. A PyQt5 graphical user interface (GUI) allows users to manage the system effortlessly. The results demonstrate accurate recognition, enabling seamless computer control and highlighting the potential of combining gesture and voice recognition for a more natural, hands-free computing experience. This technology has significant implications for accessibility, providing an alternative input method for individuals with physical disabilities. Future improvements may include expanding the command library, enhancing accuracy, and integrating the system with smart home devices or virtual assistants, showcasing the transformative potential of gesture and voice-based interactions in human-computer interaction.