Inside Typeform’s AI Agent Stack

Typeform has been integrating generative AI to enhance user experience by allowing customers to create forms efficiently through tools like Creator AI, Interaction AI, and Insight AI, as outlined by Marta Lorens, Senior Data Scientist at Typeform. Their AI strategy heavily relies on AWS for scalable infrastructure and managed services, enabling them to concentrate on developing AI experiences and orchestration without dealing with infrastructure management. A pivotal lesson learned post-launch is the continuous need for evaluation to ensure AI's relevance and effectiveness, avoiding reliance on outdated metrics. To achieve reliable AI, Typeform developed specific capabilities, including structured form generation, privacy safeguards, and detailed analytics beyond traditional product metrics. Evaluation is crucial as it transforms subjective feedback into objective insights, fostering user trust and engagement. Typeform has observed more non-engineer involvement in evaluations, enhancing the process by incorporating diverse perspectives. The role of an agent engineer at Typeform involves overseeing AI feature development, ensuring technical feasibility, and aligning with the product vision. Lorens emphasizes starting with targeted evaluation and avoiding early overbuilding to expedite reaching production. Typeform selected Arize AX for its ease of setup, customization, and support, which aligns with their specific evaluation needs and enterprise requirements.