Company
Date Published
Author
Olivia Greene, Ahmed Saef Zamzam, Maheedhar Gunturu, Prabha Manepalli, Weifan Liang
Word count
2093
Language
English
Hacker News points
None

Summary

In this emerging machine-to-machine (M2M) architecture, MQTT, Apache Kafka, and Scylla work together to provide an end-to-end IoT solution. IoT is a fast-growing market, expected to reach $6.5 trillion by 2024, with over 25 billion connected devices in 2018. The goal of this demo is to demonstrate an end-to-end use case where sensors emit temperature and brightness readings to Kafka and the messages are then processed and stored in Scylla. MQTT is used for device communication, while Apache Kafka handles high-velocity data ingestion, and Scylla provides a scalable, distributed, peer-to-peer NoSQL database that works as a drop-in replacement for Cassandra. The demo uses Confluent MQTT Proxy, Kafka Connect Cassandra connector, and Mosquitto to simulate MQTT sensor activity and publish messages to the corresponding topics in Kafka. With the alignment between MQTT, Kafka, and Scylla, application developers can easily build solutions that harness IoT-scale fleets of devices and store the data from them in Scylla tables for real-time as well as analytic use cases.