July 2019 Summaries

Aiven now supports sstableloader, an open source utility that enables seamless migration of data from external Apache Cassandra instances into a managed Aiven for Apache Cassandra cluster. This is achieved by bulk-loading data from remote SSTables into the target nodes' internode ports. The process involves connecting to the new Cassandra cluster to determine which nodes should receive specific rows, then uploading the SSTable data to the target nodes. Large clusters can now be migrated efficiently using sstableloader, making it an industry standard for bulk data loading into Apache Cassandra.

Apache Cassandra is an open-source, NoSQL, wide column data store that can quickly ingest and process massive amounts of data. It's decentralized, distributed, scalable, highly available, fault-tolerant and tuneably consistent, with identical nodes clustered together to eliminate single points of failure and bottlenecks. Cassandra is used today by CERN, GitHub, Apple, Netflix, and countless other organizations for managing large amounts of semi-variable but structured data (from sensors, connected appliances and applications) for analytics, event logging, monitoring, and eCommerce purposes, particularly when high write speeds are needed.

The text discusses the data continuum from fully-structured to unstructured data, examining various types of data stores such as relational database management systems (RDBMS), wide-column stores, key-value stores, and document stores/full-text search engines. It also compares SQL and NoSQL databases, highlighting their differences in terms of schema flexibility, scalability, latency, and performance. The text concludes by emphasizing the importance of choosing the right data store based on specific needs and considering a combination of data stores for different purposes within a data pipeline.