March 2021 Summaries

The article discusses the use of Network Load Balancers (NLBs) by Ably for distributing incoming traffic across multiple targets, ensuring low latency and high throughput. It highlights two limits encountered while using AWS NLBs: maximum target group size and connection drops. To work around these limitations, strategies such as vertical EC2 scaling and sharding with multiple NLBs were employed. The article emphasizes the importance of load testing for exploring scalability limits and ensuring dependability in cloud solutions.

The article discusses the updates in Socket.IO v4 compared to v3, focusing on improvements and migration aspects. Socket.IO is a JavaScript library for real-time web applications that enables bi-directional communication between web clients and servers. Released on 9th March 2021, Socket.IO 4 includes breaking changes at the API level on the server side, bug fixes, and new features such as support for Typed Events and Immutability. The update aims to improve code stability and maintainability but may pose challenges during migration due to potential missing functionality or compatibility issues with plug-ins and other programming languages.

Stream processing is the real-time or near-real-time processing of data "in motion." It enables querying and analyzing continuous data streams, reacting to critical events within a brief timeframe (usually milliseconds). Event streaming platforms like Apache Kafka enable the flow of data between back-end apps and services. Key use cases for stream processing include real-time fraud detection & payments, IoT sensor data, real-time dashboards, log, traffic, and network monitoring, context-aware online advertising & user behavior tracking, geofencing, and vehicle tracking, and cybersecurity. Popular stream processing platforms include Apache Spark, Apache Kafka Streams, Apache Flink, Spring Cloud Data Flow, Amazon Kinesis, Google Cloud Dataflow, Apache Pulsar, and IBM Streams. Each platform has its strengths and weaknesses, so it's essential to carefully analyze them before choosing the right one for a specific use case.