Run local AI queries on your data lake with DuckDB and Claude

The interaction with data is rapidly evolving as AI assistants like Claude can now perform tasks such as writing SQL, interpreting results, and providing insights in natural language, traditionally requiring a full cloud warehouse. This post explores how to leverage Open Data Infrastructure (ODI) to access AI-powered data experiences directly from a laptop by connecting Claude Desktop to a Fivetran-powered data lake using DuckDB as the compute engine. ODI emphasizes storing data in open formats and decoupling compute from storage, allowing flexibility and eliminating vendor lock-in. DuckDB, an in-process SQL engine, facilitates local querying of data stored in Iceberg formats, while Claude, an AI assistant from Anthropic, enhances data interaction by interpreting query results and answering analytical questions in plain English. The Model Context Protocol (MCP) links Claude to live data without the need for data export or middleware, transforming data querying into a conversational experience. This setup empowers data teams by reducing the need for extensive SQL writing, allowing them to focus more on data interpretation and action, with data remaining in an open, shared format accessible through various platforms without duplication or migration.