Build a Streaming SQL Pipeline with Apache Flink® and Apache Kafka®

Apache Kafka is a highly-available, fault-tolerant platform that makes reliable communication between streaming components easy. It serves as the perfect base for any streaming application. Apache Flink adds the power of stateful data transformations to the picture, allowing users to calculate, persist, recover and process data in a similar distributed, highly-available, fault-tolerant fashion to Kafka. Together, they form an efficient combination for creating pipelines defined using SQL. This article demonstrates how to use Apache Flink and Kafka to create streaming pipelines with SQL.