December 2021 Summaries

In 2021, DataStax focused on unleashing the power of data in digital transformation journeys by addressing fragmentation and silos to deliver value. The release of Apache Cassandra 4.0 highlighted the year with its unmatched quality, scalability, and reliability. DataStax aims to support enterprises' cloud journey through product innovations that harness real-time data both in motion and at rest. For 2022, DataStax plans to continue partnering with businesses to unlock their data and deliver products developers love.

In recent years, messaging and event stream processing technologies have evolved from niche products into core components of modern data architecture. Factors driving this change include the growth of open-source projects, microservices-based architectures, and recognition of real-time data processing's strategic value. Nearly 64% of companies plan to adopt event stream processing technology within the next year. Event streaming systems require dynamic scaling capabilities to handle large data volumes without potential loss. They also need to provide real-time access for time-sensitive applications like fraud detection and ad hoc analytics for driving reports, dashboards, and ad hoc analytics. Microservices-based architectures can benefit from event stream processing through decoupling systems, enabling more flexible scaling with minimal system changes. Unified data architecture for event streaming is now possible due to open-source projects and technologies like microservices-based architecture.

Season 3 of the Inspired Execution podcast featured interviews with leaders from renowned brands such as Google, Adobe, and US Bank. The podcast delved into their experiences, lessons learned, and principles of Inspired Leadership. The season was short but thoughtful and personal, offering valuable insights for listeners to create their own playbook for success.

Zhamak Dehghani, a leading expert on distributed systems and big data architecture, introduced the concept of Data Mesh in 2018 to revolutionize how companies interact with their data. The approach aims to unlock value from data and make it more accessible by decentralizing responsibility for data quality and management within each domain of a company. Key principles of the Data Mesh approach include domain ownership, treating data as a product, leveraging self-serve data platforms, and implementing federated computational governance. Dehghani's ideas have gained traction in various industries, offering companies an alternative to traditional centralized data management systems.

GraphQL and graph databases, though often considered unrelated, have a complex relationship that is worth exploring. Graph databases are efficient in storing and retrieving data with relationships, while GraphQL helps app developers move faster by minimizing network hops to clients and collecting related information in one query. Both technologies carry the concept of a graph, but in different ways: GraphQL has it in metadata and schema structure, while graph databases have it in the actual data. These two can be used together or separately, depending on the specific needs of an application.

AWS re:Invent 2021 marked the return of an in-person event after a COVID-19 hiatus, featuring numerous new product announcements. One key trend observed was the shift from time-based provisioning to consumption-based pricing for several data services, reflecting the growing adoption of serverless offerings. AWS also made significant changes to egress pricing, offering free transfers for the first 1TB on CloudFront and 100GB for standard compute, which is beneficial for organizations using multiple regions and cloud providers. Another notable development was the introduction of "Mainframe Modernization," a new initiative aimed at helping businesses transition from mainframe-based applications to more modern architectures. AWS's announcements cover various verticals, but the focus should be on strategy and execution in digital transformation efforts rather than an extensive catalog of products.

DevOps teams benefit from automation, which is supported by Infrastructure-as-code (IaC). The DataStax Astra DB Terraform provider allows for declarative configuration and management of databases on DataStax Astra DB. This makes it easy to script the creation of a database, roles, security tokens, access lists, and more. The Astra DB Terraform provider is free, supported, and maintained by DataStax, and can be used with any cloud provider. It enables users to create databases, keyspaces, access lists, private endpoints, roles, and tokens on Astra DB Serverless. The project source code is open-source and available on Github under the Mozilla public license 2.0.