June 2021 Summaries

The transition from on-premises to cloud computing has accelerated as companies increasingly prioritize speed and cost efficiency over previous data security concerns, with data analytics being a prime candidate for cloud migration. While Infrastructure as a Service (IaaS) shifts traditional server management to the cloud, it doesn't fully alleviate the complexities of managing data analytics, leading to the rise of Software as a Service (SaaS) platforms like Snowflake, Google BigQuery, and Amazon Redshift, which simplify operations and reduce management overhead. These platforms are well-suited for historical data analysis, but the demand for real-time operational analytics is pushing companies towards specialized platforms like Druid, Pinot, and Clickhouse, which require careful architectural planning to handle data complexity and performance requirements. Rill Data offers a SaaS solution leveraging Apache Druid to meet these real-time needs, providing high-performance, secure, and cost-effective sub-second query capabilities without the maintenance burden, allowing companies to focus on deriving insights rather than managing their data infrastructure. As operational intelligence becomes crucial, those opting for managed solutions are likely to be more agile and successful compared to those maintaining custom data services.

Apache Druid, an open-source tool designed for real-time analytics, lacks a native connector for BigQuery, a highly scalable data warehouse that excels in storage and modeling but not in sub-second data access. Rill's managed cloud service bridges this gap by allowing seamless integration between Druid and BigQuery, enabling businesses to leverage both platforms for optimal data processing and analysis. With Rill's BigQuery connector, users can easily ingest data from BigQuery into Druid, facilitating scenarios such as keeping recent data in Druid for rapid access while using BigQuery for periodic reporting. Rill's autoscaling feature ensures fast and efficient data ingestion, scaling resources as needed to handle large datasets without the need for extensive DevOps involvement, often reducing ingestion times to under 30 minutes for terabyte-sized data. Rill aims to integrate with all standard analytics tools, allowing companies to analyze data efficiently while providing support for setting up the integration and fast data analysis tailored to business needs.