A universal test suite for Ably SDKs
Blog post from Ably
Ably has revolutionized its SDK development process by leveraging large language models (LLMs) to enhance efficiency and quality. Traditionally, Ably's SDKs spanned a wide range of platforms and languages, relying on a comprehensive specification to ensure consistency. However, inconsistencies in interpretation, development effort, and test coverage posed significant challenges. The introduction of AI-powered LLMs allowed Ably to construct a Universal Test Suite (UTS), which employs natural language to specify tests that LLMs can translate into code for different platforms. This advancement led to the creation of a Dart library with improved test coverage and traceability compared to previous libraries. By allowing AI to handle the mechanical aspects of code translation, human developers can focus on critical design decisions, resulting in a substantial boost in development speed and reliability. This approach not only streamlines the process but also sets a new standard for future SDK enhancements, such as the AI Transport SDK, demonstrating the transformative potential of AI in software development.