Abstract

Existing gesture-controlled devices for Human-Computer Interaction are often expensive, require cameras, or have steep learning curves. This study introduces a wearable, portable, and cost-effective palm-worn device for touchless Human-Computer Interaction, using a library of hand movements translated to keyboard commands. The circuit was designed using an MPU6050 accelerometer and gyroscope to obtain angle and acceleration data, an ESP32 microcontroller for processing, and an ESP32 firmware to convert the received sensor data into hand gestures and corresponding keyboard commands, and to connect the device via Bluetooth. Results from testing showed 99.67% accuracy in measured angles of movement, 99.68% accuracy in translation of sensor data to corresponding hand gestures, and 99.90% accuracy in the keyboard commands registered for each gesture. The device serves as a cost-effective alternative to other, more expensive gesture-controlled systems and as an interface for individuals who are less familiar with the daily use of digital devices, offering a smoother learning curve.

Key words: Hand Tracking, Gesture Control, ESP32, MPU6050, Gyroscope, Accelerometer, IMU Sensor