August 2024 Summaries

Fly.io is a new public cloud that aims to provide simple and developer-friendly ergonomics with less financial risk compared to traditional public clouds. The company acknowledges the terrifying aspect of public cloud billing, where unexpected charges can accumulate rapidly due to various factors such as misconfigurations or leaks in CI/CD environments. Fly.io offers an implied accident forgiveness policy, wherein providers often concede disputed bills. However, this approach is not considered ideal and may lead to stress for developers. Fly.io plans to implement an explicit accident forgiveness billing system that will allow customers to have a line-item veto on their invoices. This feature is currently under development and will be rolled out incrementally due to concerns about fraud. For now, Fly.io offers almost automatic refunds for unexpected charges on bills for customers with support contracts. The company also plans to work on accident protection features that prevent incurring unnecessary charges in the first place. Fly.io's approach is aimed at making developers more comfortable and willing to try new things without fear of enormous, unexpected bills. This commitment to customer satisfaction sets Fly.io apart from other public cloud providers.

Fly.io has recently lowered the prices of NVIDIA L40S GPUs to $1.25 per hour, making them more affordable for developers. The company offers four different GPU models, with the A10 being the most popular among users due to its capability and affordability. Fly.io's strategy is based on customer data, which shows that most users are looking for inference-based AI workloads rather than training ones. As a result, they have decided to focus more on providing GPU solutions for these types of tasks. The L40S GPUs offer performance comparable to the A100 at a lower price point, making them an attractive option for developers.