Introducing chdb Postgres extension: High-performance imports from cloud storage

ClickHouse has introduced chdb, a PostgreSQL extension built on the in-process chDB ClickHouse engine that broadens PostgreSQL import and export capabilities across numerous data formats and cloud storage systems. In benchmarks loading a one-million-row NYC Taxi dataset from Amazon S3, chdb showed consistently faster performance than DuckDB-backed pg_lake and pg_duckdb for CSV, JSON, and Parquet imports, while aws_s3 was competitive but supported fewer formats. The package includes a chdb extension for executing individual chDB queries and a chdb_hook module that integrates with PostgreSQL COPY commands to read and write data through URLs for S3, Google Cloud Storage, Azure Blob Storage, HTTP, local files, and HDFS, including wildcard-based multi-file imports and table creation with inferred schemas. It supports a broad range of ClickHouse formats and compression methods, maps most PostgreSQL and ClickHouse data types, and uses an on-demand helper process rather than embedding chDB directly in PostgreSQL backends to limit persistent resource use and isolate failures. Planned work includes expanded type mappings, credential-chain support, additional COPY features, Iceberg compatibility, and direct querying of storage files.

No tracked trend matches for this post yet.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.