Home / Companies / Google Cloud / Blog / Post Details
Content Deep Dive

SignAll SDK: Sign language interface using MediaPipe is now available for developers

Blog post from Google Cloud

Post Details
Company
Date Published
Author
-
Word Count
1,406
Language
English
Hacker News Points
-
Summary

SignAll, a startup specializing in sign language translation technology, has made strides in accessibility by integrating Google's MediaPipe hand tracking technology into its systems, allowing for the development of a sign language SDK that operates without the need for gloves or special lighting. This advancement facilitates the accurate tracking of hand, body, and face data using a single camera, significantly enhancing SignAll's offerings, which are already widely used across the United States for communication and education purposes. By leveraging MediaPipe, SignAll has been able to transition from a complex multi-camera setup to a more streamlined solution, making sign language input more accessible and versatile across various applications, such as video calls and navigation input. The SDK is now available for developers, paving the way for broader implementation of sign language features in apps and services, all while maintaining compatibility with SignAll’s extensive database of over 300,000 annotated sign language videos. The collaboration with MediaPipe not only simplifies the technical requirements but also allows for scalability across multiple platforms, including Windows, iOS, Android, and the web, with potential future enhancements through custom MediaPipe graphs and WebAssembly technology.