Generative AI and Starburst: Pioneering natural language interfaces for data exploration

Starburst is exploring the integration of large language models (LLMs) into its data exploration tools, aiming to develop a natural language interface that allows users to query organizational data without needing extensive SQL knowledge. Despite the transformative potential of LLMs, exemplified by their ability to perform tasks like converting queries or identifying tables with personal data, there are concerns about accuracy and reliance on flawed outputs, which have led Starburst to delay releasing a customer-facing product. The company has been experimenting with various projects, such as a prototype that translates natural language queries into SQL and provides an audit trail for transparency. While this technology could broaden Starburst’s user base by simplifying data access, current limitations and the need for precision mean SQL will likely remain the preferred tool for complex queries among experienced users. The ongoing research and development, fueled by successful internal hackathons and customer deployments, suggest exciting future announcements in this space.