SignAll SDK: Sign language interface using MediaPipe is now available for developers
Blog post from Google Cloud
SignAll, a startup specializing in sign language translation technology, has made strides in accessibility by integrating Google's MediaPipe hand tracking technology into its systems, allowing for the development of a sign language SDK that operates without the need for gloves or special lighting. This advancement facilitates the accurate tracking of hand, body, and face data using a single camera, significantly enhancing SignAll's offerings, which are already widely used across the United States for communication and education purposes. By leveraging MediaPipe, SignAll has been able to transition from a complex multi-camera setup to a more streamlined solution, making sign language input more accessible and versatile across various applications, such as video calls and navigation input. The SDK is now available for developers, paving the way for broader implementation of sign language features in apps and services, all while maintaining compatibility with SignAll’s extensive database of over 300,000 annotated sign language videos. The collaboration with MediaPipe not only simplifies the technical requirements but also allows for scalability across multiple platforms, including Windows, iOS, Android, and the web, with potential future enhancements through custom MediaPipe graphs and WebAssembly technology.