Hardware

1. 3D Printed Animatronic Hand
2. Tower Pro Servos (SG90)
3. Logitech Web Cam
4. Arduino
5. IMU - MPU6050.

About the project

This project was done as a part of the NJIT Hardware Hackathon 2023, “Byte into Hardware”. This was a 24-hour hackathon where we had to develop a working model on the theme of Assistive Technology. We targeted assistance for workers in “Hazardous Environments” and as PoC for teleoperative assistance, we executed this project.

The project uses Computer Vision to perform gesture tracking and interpret the gestures made by the user. This is then sent to the Arduino as actuation commands to make the Animatronic hand replicate the gesture. To complete the loop, we used a Logitech webcam to provide a video feed to the user by coupling it with servos for yaw control. The command to the yaw control is given via an IMU that tracks the yaw of the user’s head.

More detailed breakdown of the project can be found in the repository here.