Company
Date Published
Author
Vincent Lam
Word count
414
Language
English
Hacker News points
None

Summary

Introducing New dbt Core Integration and Real-Time CDC Sources for CData Sync The CData team is dedicated to providing flexible, easy-to-use, and robust data pipeline technology to support customers' data integration needs as enterprises leverage Sync to move their data from over 250 sources. The new features allow users to work collaboratively within the extended data ecosystem for demanding use cases. dbt Core provides new solutions for transformation adding to Sync's native transformation capabilities. It addresses some of the drawbacks in large organizations where data wrangling is typically the domain of scarce data engineers. The tool offers a workflow environment where analysts write business logic in SQL, transforms are tested, code is executed, and documentation is created. This latest CData Sync release also adds support for real-time Change Data Capture (CDC) for Oracle and MySQL in addition to SQL Server and PostgreSQL. CDC allows users to replicate data in real-time by automatically tracking updates in source data as they occur. A new History Mode for replication jobs with CData Sync appends a timestamped entry of every change that occurs in the source, allowing users to audit a source for any creates, updates, or deletes without having to modify existing applications. Available on-premises or in the cloud via AWS or Azure, CData Sync makes it simple to replicate and transform all the data needed.