Executable UDFs are now generally available on ClickHouse Cloud

ClickHouse Cloud has made executable user-defined functions generally available across AWS, GCP, and Azure, adding a Native runtime for statically linked Rust, Go, C++, and Bun-compiled JavaScript binaries, outbound network access for Python UDFs, memory limits, determinism settings for query caching, API and Terraform management, and detailed per-query observability metrics in ClickHouse 26.6+. The announcement demonstrates using UDFs for LLM accounting: a Rust tokenizer runs at ingestion through a materialized view to count system, context, user, and completion tokens, while a Python network-enabled UDF periodically asks Claude to evaluate sampled responses. Token counts can be combined with externally refreshed model pricing data to estimate costs, fill gaps in provider-reported usage, identify prompt components that may benefit from caching, and relate expensive prompts to quality failures. The post also compares Rust, Python, and Go tokenizer implementations, finding Rust fastest for this workload, and offers operational guidance including using reusable executable pools, processing larger chunks, flushing per chunk, monitoring pool waits and resource usage, and reserving UDFs for tasks impractical in SQL. Planned enhancements include secret management, per-service runtime configuration, Native-runtime networking, and additional runtimes.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.