Announcing General Availability of ClickHouse Full-text Search

ClickHouse has introduced Full-text Search as a generally available feature, offering a significant performance boost for token-based text searches by employing native inverted indexes, similar to those in search technologies like Lucene. This new capability enables fast, scalable searches across large datasets, delivering query speeds up to 7-10 times faster compared to traditional methods, and proving more effective than Bloom filters due to its deterministic results and scalability. Full-text Search is particularly suited for analytical workloads involving large volumes of text data, allowing users to efficiently perform searches and aggregations over billions or even trillions of rows, as exemplified by its application in platforms like Ryft.io and Icite. Despite the increased storage overhead of text indexes compared to Bloom filters, the trade-off is offset by substantial query performance improvements. ClickHouse's implementation allows customization through tokenization and pre-processing options, enabling users to tailor searches to specific requirements. The introduction of this feature aligns with ClickHouse's strengths as a high-performance analytical database, enhancing capabilities for analytics and observability workloads.