June 2023 Summaries

Mendable is a SaaS platform that integrates AI chat search into applications, primarily used for documentation, customer support, internal training, and product copilators. The company has experienced rapid growth, with over 400K messages queried on its platform in the previous month. Mendable's tech stack includes Railway, which handles most of the workload, as well as custom-built services using JavaScript and Python. As the company expands, it is addressing challenges such as rate limiting, overloaded models, and exploring open-source LLMs to improve its service. Readers can learn more about Mendable by visiting its website and following the company on Twitter.

Banana.dev is a serverless GPU platform designed for real-time machine learning inference, aiming to simplify infrastructure management and reduce costs by autoscaling GPUs on demand. The company's founder, Erik Dunteman, emphasizes the importance of minimizing queuing and ensuring fast responses in AI-powered applications. Banana serves a wide range of customers, including those with custom models like CLIP and Whisper, and is built using Railway, another platform that aims to reduce developer mindshare for infrastructure tasks. By leveraging multi-tenant scaling and optimized cold start solutions, Banana enables users to deploy models quickly and easily without worrying about underlying infrastructure. The company provides resources for getting started, including one-hour GPU credits, templates, and a community-driven repository of exciting models.

The Railway team is introducing changes to their pricing and plans for 2023, which will become available on July 3rd and conclude on August 1st. The new plans include Trial, Hobby, and Pro, with the goal of providing better service and support to production users and teams. The changes aim to disincentivize abuse by introducing charges for certain dimensions of usage, such as network egress. The free plan will be replaced by a one-time grant of $5 in credits, while developers on Starter plans will have distinct migration paths. The Hobby plan will cost $5 per month with $5 of usage included, and verified users will receive the subscription fee waived. Network charges for egress will start at $0.10 per GB, but no charge for ingress will be applied. The changes are intended to elevate the level of service and support provided to legitimate users, while reducing the fraud load dealt with in support.

The company behind the platform Railway has been growing rapidly and has noticed that its pricing model is confusing, particularly with its free tier. They want to disincentivize abuse by altering the free experience but don't think traditional SaaS approaches like paywalls or slower builds would be a good fit. Instead, they're introducing a new pricing model where Railway will cost $5 per month by default, with a one-time $5 free credit for users who want to continue using it after that. The platform will also offer more features and improvements, including private networking, dynamic persistent disks, lifecycle management, spend/resource limits, and regions, all of which will be built into the platform instead of being offered as external services.