March 2023 Summaries

ChatLLaMA is an open-source chat alternative released by a few Baseten engineers as a weekend project, using Alpaca-7B, a fine-tuned variant of LLaMA designed for chat interfaces. Blueprint now supports fine-tuning FLAN-T5, an instruction-tuned text-to-text-transfer-transformer model developed by Google, allowing users to customize their own large language models with their data. Fine-tuning LLMs enables building specialized generative apps, saving money compared to using generic APIs, and owning one's model. Baseten engineers have been working on various side projects using LLMs and generative AI, including ChatLLaMA, which hit #1 on Hacker News, and other initiatives such as an AI-powered dev infrastructure tool and a quick poetry generator. Baseten has achieved SOC 2 Type II certification and HIPAA compliance, ensuring the security and stability of sensitive data. The company is hosting another AI meetup in April.

Baseten has achieved HIPAA compliance through a requirements analysis and internal audit driven by Drata, ensuring the confidentiality, integrity, and availability of sensitive health information when deploying ML models. The company's infrastructure and operations have been verified to adhere to industry standards for security and reliability. This achievement is further certified by a SOC 2 Type II audit. Baseten invites organizations handling PHI to deploy and manage ML models while maintaining HIPAA compliance. Reports detailing the company's compliance measures are available upon request.

Baseten has achieved SOC 2 Type II certification through a rigorous audit by Sensiba San Filippo LLP, demonstrating its dedication to providing secure and reliable infrastructure for hosting ML models. The company provided detailed statements and substantial evidence about its product and operations, covering best practices across five trust services criteria: security, availability, processing integrity, confidentiality, and privacy. With no noted exceptions in the audit report, Baseten's controls were found to be "suitably designed" for over 70 specific sub-criteria, showcasing the company's careful custody of customer information and robust infrastructure. The certification is a testament to Baseten's commitment to providing customers with a reliable and trustworthy platform for critical ML-powered business processes.

Baseten has achieved SOC 2 Type II certification and HIPAA compliance, a testament to its commitment to security and customer trust. By prioritizing development practices from day one, such as code review, automated testing, and modular architecture, the company was able to lay the groundwork for compliance. The addition of solid security practices, including data minimization and alerts, further strengthened its position. A penetration test validated its claims, while tooling like Drata streamlined documentation and tracking. For Baseten, SOC 2 certification is not just a checkbox but a reflection of its ongoing commitment to security and customer trust.