October 2024 Summaries

In this article, the author discusses how they improved the speed of system table queries in Cloud Dedicated by implementing techniques such as predicate pushdown, multiple filters optimization, and concurrent data fetching. These improvements led to significant performance gains, particularly for databases with large amounts of metadata. The changes reduced query times, making it easier to retrieve relevant system data efficiently and eliminating long debugging waits.

System tables in InfluxDB are virtual tables that store metadata for a specific database and provide insights into its storage. They are read-only and hidden by default, requiring a debug header to access. The three main system tables discussed here are system.tables, system.partitions, and system.compactor. Querying these tables can impact write and query performance, so it's recommended to use filters for optimization.

The article discusses the integration of Next.js and InfluxDB for storing and analyzing real-time stock trading data. It highlights the advantages of using InfluxDB, a time series database, for handling large volumes of historical data with efficient compression algorithms and flexible retention policies. The application architecture consists of a frontend built with Next.js, an API layer handling data fetching and writing operations, Alpha Vantage API as the data source, and InfluxDB 3.0 Cloud Serverless bucket as the database for time series stock data. Key technologies and functions used include Next.js, InfluxDB v3 JavaScript Client, Alpha Vantage API, and handling of time series data with logic to filter and adjust timestamps. The application demonstrates real-time analytics capabilities by periodically querying InfluxDB for the latest data.

This tutorial demonstrates how to build a Metrics as a Service (MaaS) solution for Node.js applications using PM2 and InfluxDB. The application collects, stores, and analyzes critical performance metrics, enabling data-driven decisions and improved user experience. Key technologies include Node.js with Express framework, PM2, InfluxDB 3.0 Cloud, InfluxDB Node.js v3 Client Library, and dotenv for keeping credentials private. The process involves collecting server metrics with PM2, writing metrics to an InfluxDB bucket every five seconds, querying metrics using SQL from InfluxDB, and visualizing the data in the web app or InfluxDB Cloud Data Explorer.

Metrics as a Service (MaaS) is a scalable, cloud-based solution that enables organizations to collect, store, and analyze performance data efficiently. InfluxDB, a leading time-series database, offers key advantages for MaaS platforms, including time series data specialization, scalability, flexibility, high-performance query engine, rich query language, and easy integration with other tools. Common use cases of MaaS include application monitoring, IoT device monitoring, and DevOps pipelines. To learn more about MaaS and InfluxDB, consider attending webinars or enrolling in free training offered by the company.

This guide provides a comprehensive walkthrough of setting up InfluxDB Cloud Serverless on macOS to manage and analyze time-stamped data effectively. It covers the installation process, configuration settings, and integration with external tools like Grafana for enhanced visualization capabilities. The article also discusses downsampling techniques to optimize storage and query performance in high-frequency time series applications. Overall, this guide serves as a valuable resource for anyone looking to leverage InfluxDB Cloud Serverless for their projects or experiments involving real-time data intelligence systems.

This tutorial guides users through setting up a seamless pipeline that collects real-time data from garden sensors, streams it through Kafka, and stores it in InfluxDB for monitoring and analysis using Telegraf. The requirements include Docker and Docker Compose installed on the system, an InfluxDB Cloud v3 account with necessary details, Python, and basic knowledge of Kafka, Telegraf, and InfluxDB. The example demonstrates how to create a containerized environment for running the garden_sensor_gateway.py script that simulates garden sensor data and sends it to a Kafka topic. Additionally, it explains the docker-compose.yml file that defines services required for the project, including Kafka, Zookeeper, Telegraf, and the garden sensor gateway. The mytelegraf.conf configuration file is also discussed, which sets up Telegraf to process the garden sensor data by consuming messages from the Kafka topic and writing them to InfluxDB Cloud v3.

In this tutorial, we explore how to integrate Bytewax, an open-source Python framework for building highly scalable dataflows, with InfluxDB, the leading time series database and platform. The integration allows users to tackle common challenges such as downsampling or materialized views, which are essential for managing time series data for long-term storage without losing critical trends. By leveraging Bytewax's tools and tutorials, users can create scalable data pipelines that prepare their data for insightful analysis with InfluxDB Cloud v3. The corresponding repository for this blog post can be found here.

The author built a docker container to create their own streaming TV station using their collection of ripped DVDs. The system randomly selects media from the local library and makes it available via RTMP and HLS, playing its own schedule like a regular TV channel. It includes features such as allow and block lists for media, ability to set broadcast window, dynamic broadcast triggering, writing play history and other stats into InfluxDB, and an API endpoint to skip to the next episode. The author chose to use InfluxDB due to its time-series database feature that allows easier exploration and analysis of play history.

This article provides a step-by-step guide on how to build an IoT sensor project using Node-RED, InfluxDB, and Raspberry Pi. The hardware setup includes a Raspberry Pi with peripherals, GPIO HAT (optional), breadboard, ultrasonic sensor, LED light, resistors, and jumper wires. The software setup involves installing InfluxDB Cloud and Node-RED on the Raspberry Pi. Two flows are created in Node-RED: Flow 1 turns an LED on/off from Node-RED and saves the data in the InfluxDB Cloud bucket, while Flow 2 connects an ultrasonic distance sensor to the Raspberry Pi and calculates distances using the classic mathematical formula. The article concludes by encouraging readers to explore further possibilities with IoT and share their creations.

This article provides a comprehensive guide to using InfluxDB's JavaScript API for time series data management. It covers the prerequisites, an overview of the InfluxDB API, setting up InfluxDB 3.0, and a hands-on tutorial using the Node.js client library. The article also discusses best practices for using the InfluxDB API to optimize performance and efficiency. By following this guide, developers can effectively integrate InfluxDB into their applications for handling large amounts of time-stamped data.