/plushcap/analysis/airbyte/becoming-a-data-engineer-2023

12 Things You Need to Know to Become a Better Data Engineer in 2023

What's this blog post about?

In this blog post, we discuss 12 key trends in data engineering that will shape the industry in 2023. These include SQL and Python dominating as programming languages, with Rust emerging as a promising contender; abstraction through custom ETL being replaced by data connectors; streaming data becoming more popular than batch processing; architecture improvements such as the lakehouse and semantic layer combining strengths; trust in data quality and observability becoming essential; usability focusing on data products and data contracts; openness with open-source tools dominating; standards simplified by DuckDB; roles expanding knowledge into data engineering; collaboration through DataOps reducing data silos and improving teamwork; adoption of data engineering regardless of industry or business size; and community interaction on various platforms.

Company
Airbyte

Date published
Dec. 9, 2022

Author(s)
Thalia Barrera

Word count
4027

Hacker News points
5

Language
English


By Matt Makai. 2021-2024.