October 2022 Summaries

Baseten has recently launched several features, including a new community platform called The DSC, which allows users to find and connect with others who share similar interests in the ML industry. The company also introduced a new integration with MLflow, enabling users to deploy MLflow models on its platform. Additionally, Baseten has welcomed a new team member, Zack, a software engineer from Amazon Prime Video, and is actively hiring for a Lead ML Engineer and an Account Executive. The company is also publishing daily changelogs this week and has several upcoming projects in the works, including more advanced use cases for powerful models like Stable Diffusion and Whisper.

Whisper` is OpenAI's open-source neural network for automatic speech recognition, offering a paradigm shift from "cool one day" technology to "this technology has arrived". It can capture multiple languages with stunning accuracy and is deployable as a pre-trained model or packaged and deployed using Truss, an open-source model packaging and serving library. The model invocation involves pre-processing work to turn the input into something it can use, and its deployment on Baseten takes just a few clicks. The author, a new grad software engineer, successfully deployed Whisper using Truss and has worked with the model in various situations, including a high-throughput project for Patreon.