How Portola empowers subject matter experts to improve AI quality
Blog post from Braintrust
Portola's AI companion app, Tolan, aims to create authentic, non-romantic relationships with users by focusing on genuine emotional connections through natural voice interactions and complex memory systems. The company employs a unique workflow that empowers nontechnical subject matter experts, such as a behavioral researcher, science fiction writer, and game designer, to identify issues, curate datasets, and deploy prompt improvements directly to production, bypassing engineering bottlenecks. This approach facilitates a 4x increase in prompt iteration speed and enhances conversation quality by systematically addressing edge cases related to memory recall, conversation flow, and sensitive topics. Portola's strategy emphasizes the importance of manual review and human judgment in emotionally complex domains, underscoring the value of empowering domain experts to drive quality improvements in AI interactions.