Home / Companies / ClickHouse / Blog / Post Details
Content Deep Dive

GCP Pub/Sub connector for ClickPipes is now in Private Preview

Blog post from ClickHouse

Post Details
Company
Date Published
Author
Summary
Word Count
741
Company Posts That Month
82
Language
English
Hacker News Points
-
Summary

A new GCP Pub/Sub connector for ClickPipes is now available in Private Preview, allowing users to stream data from GCP Pub/Sub into ClickHouse Cloud in real time with minimal setup. This connector supports common formats such as JSON, Avro, and Protobuf, and integrates with schema registry to handle schema inference and message delivery automatically. Users can manage the connector programmatically via OpenAPI and the ClickHouse Terraform provider, offering features like attribute-based message filtering, flexible seek options, and per-key ordered delivery. The connector is optimized for ClickHouse Cloud's architecture, supporting high-throughput topics with built-in metrics, monitoring, and detailed logs for insight into the pipeline. It eliminates the need for routing through GCS or Dataflow, providing a simpler, fully managed ingestion solution that enhances performance and reduces costs.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
Real-time 2 5,457 1,338 238 -5%