July 2020 Summaries

NewSQL databases, a term coined in 2011, aim to combine the scalability of NoSQL systems with the ACID compliance of traditional relational databases, addressing challenges faced by enterprise systems that require both high scalability and transactional consistency. The key distinction of NewSQL databases lies in their underlying storage engine, which should be specifically designed to handle these requirements efficiently, unlike traditional RDBMS and NoSQL systems. While RDBMS struggle with high-scale data ingestion and NoSQL systems lack ACID compliance, NewSQL databases attempt to bridge these gaps by minimizing read and write overhead. The article emphasizes the importance of an optimized storage engine for NewSQL databases, illustrated by recent developments in systems like Harper and Pingcap, which aim to enhance both read and write performance without the drawbacks associated with traditional database systems.

HarperDB and Dianomic Systems have announced the integration of the HarperDB Plugin into the Fledge open-source framework, which is maintained by Dianomic and designed for industrial edge applications. Fledge aims to streamline operations by integrating Industrial Internet of Things (IIoT) sensors with cloud and existing systems, thereby eliminating data silos in industrial settings. This collaboration allows for the aggregation and distribution of data for enterprise applications, enabling real-time operational analytics at scale. HarperDB's storage engine complements Fledge's capabilities, supporting Industry 4.0 initiatives by simplifying data management as companies handle increasing sensor data volumes. The partnership between HarperDB and Dianomic enhances the Fledge community, offering advanced IIoT and machine learning solutions, and the HarperDB Storage Plugin is now available on GitHub.