Prosthesis control via Mirru App using MediaPipe hand tracking

The Mirru app, developed by Violeta López and Vladimir Hermand in collaboration with Tweag, is an open-source Android application designed to control robotic prosthetic hands using MediaPipe's hand tracking technology. By allowing users to mirror movements from their sound hand onto a prosthetic hand, Mirru provides a cost-effective and accessible alternative to traditional myoelectric muscle sensors, which are often expensive and cumbersome. The app is compatible with open-source prosthetic models like the Brunel Hand and relies on a Bluetooth-enabled Arduino board for control. The MediaPipe framework facilitates real-time hand movement translation without the need for custom machine learning models, making it a practical solution for those with limited resources. This innovative approach not only reduces the financial barriers associated with prosthesis customization but also empowers users to program and save an unlimited number of grip patterns. As the team continues to explore the integration of hand tracking with myoelectric sensors, they are eager to see how the open-source community will further develop and expand the application.