June 2022 Summaries

Monitoring is an essential aspect of the software development lifecycle, yet it often takes a backseat in developers' priorities. Application snapshots, which capture the state of an application at a specific moment, are highlighted as a valuable but underutilized tool for enhancing observability, especially for debugging and investigating exceptions. These snapshots offer a deeper level of insight compared to traditional logs, metrics, and traces, and are akin to a live debugging session, making them more intuitive for developers. The discussion explores the concept of dynamic observability, which allows real-time instrumentation and data collection without stopping or altering the application, thus addressing developers' need for more responsive and flexible monitoring tools. Despite their potential, the widespread adoption of snapshots is hindered by a lack of standardization and varying levels of support across different programming languages and tools. The article calls for greater alignment among vendors and users to establish interoperability standards akin to OpenTelemetry, to better integrate snapshots into developers' workflows and popular IDEs, enhancing their debugging experience.

Synthetic Monitoring has emerged as a crucial tool for monitoring the uptime and critical processes of applications, allowing DevOps, IT, and engineering teams to respond swiftly to issues. Though typically costly, a cost-effective approach can be achieved using open-source tools like Telegraf, part of the TICK stack, which enables internal Synthetic Monitoring by collecting data behind a firewall. Telegraf supports a range of API integrations and facilitates exporting and collecting metrics, making it versatile for internal monitoring needs. For those operating in serverless and public infrastructures, Logz.io offers serverless Synthetic Monitoring solutions via Golang-based Lambda functions, which can monitor site, API, and certificate availability by sending data to Logz.io accounts. These solutions are easily deployable and provide prebuilt dashboards for comprehensive monitoring. Logz.io emphasizes its commitment to open-source technologies, enabling users to customize and utilize its offerings for specific use cases, all while offering a free trial to explore its capabilities.

Synthetic Monitoring is a proactive technique used to simulate and monitor user interactions with applications to ensure their functionality, availability, and response times. Unlike Real User Monitoring, which tracks actual user interactions, Synthetic Monitoring uses scripted transactions to mimic user behavior and can be conducted continuously across various geolocations and devices. This method helps identify issues before they impact real users and is particularly valuable for testing new features in pre-production environments. It complements passive monitoring by offering insights during low-traffic periods and is crucial in today's digital economy, where application performance directly influences business outcomes. As digital experiences become increasingly tied to revenue, Synthetic Monitoring provides an automated and efficient solution to detect and address potential problems, such as downtime or slow response times, that could lead to significant financial losses.

Logz.io's placement in the Visionary Quadrant of the 2022 Gartner Magic Quadrant for Application Performance Monitoring and Observability reflects its commitment to pushing the boundaries of open-source technology for observability and APM. The company has focused on creating a scalable SaaS platform that integrates open-source tools such as OpenTelemetry, OpenSearch, and Jaeger, emphasizing accessibility and integration ease. Logz.io aims to reduce data volumes and costs while enhancing insights, with a strong emphasis on embedding security throughout its services. The company has expanded its offerings from logging to include Cloud SIEM and continues to innovate by incorporating new telemetry types and security features. This commitment to open source and security integration positions Logz.io to influence market trends and break down traditional silos between development and security, empowering engineers to build secure systems.

Logz.io has introduced Alert Manager, now in Public Beta, to enhance its Infrastructure Monitoring product by simplifying the creation, management, and customization of metric alerts. The Alert Manager's integration with Prometheus Alert Manager allows for seamless migration of existing alerts, optimizing the monitoring experience for users. By utilizing PromQL, users can craft specific alert rules and monitor metrics effectively, while the alert conditions can be fine-tuned to avoid false triggers. The platform supports various notification endpoints like Slack and PagerDuty, enabling users to configure contact points and notification policies efficiently. Additionally, Alert Manager offers features like silences to temporarily mute notifications during maintenance and alert groups to consolidate alerts, thus preventing notification overload. With the promise of AI-powered observability, Logz.io encourages potential users to participate in the Beta program to experience these new capabilities firsthand.

Logz.io has been recognized as a Visionary in the 2022 Gartner Magic Quadrant for Application Performance Monitoring and Observability, highlighting its achievements in expanding from logs management to a comprehensive observability platform. By addressing the challenges of monitoring and troubleshooting cloud infrastructure and applications, Logz.io serves over 1,300 customers worldwide. The company's platform emphasizes cost-effective data management, helping organizations reduce overhead by focusing on meaningful data and optimizing data storage. Logz.io's commitment to open source remains strong, offering flexibility and community support to enhance observability efforts, while its multi-cloud approach ensures global service resilience and data sovereignty across platforms like Microsoft Azure and AWS. These strategies aim to simplify the complex process of APM and observability, providing tailored solutions that cater to the evolving needs of modern enterprises.

In a discussion on the OpenObservability Talks podcast, Dotan Horovits and guest Liran Haimovitch, co-founder and CTO of Rookout, explore the evolving role of observability in software development, emphasizing its importance beyond traditional operations monitoring. Haimovitch highlights that for developers, observability is about facilitating daily tasks, such as debugging and understanding application behavior in cloud environments, rather than just assessing system uptime or bottlenecks. The conversation touches on the challenges developers face with specialized observability tools like distributed tracing and metrics, which are often more accessible to centralized teams with dedicated expertise. Haimovitch argues for a more inclusive approach to observability tools, suggesting they should be tailored to everyday developers to enhance their connection to production environments and improve software quality. Additionally, the discussion suggests that observability should be integrated into pre-production environments to streamline development processes, and that a shift in focus is needed to empower developers as key consumers of observability solutions.

On May 27, 2022, a security research team called nao_sec identified a new Microsoft Word document vulnerability, later named the "Follina" vulnerability, which allows attackers to execute malicious code on a target machine using the ms-msdt MSProtocol URI scheme without relying on macros. The vulnerability was initially undetected by Microsoft Defender for Endpoint and affects all versions of Office, with no immediate patch available. Logz.io has created a detection rule for this vulnerability, CVE-2022-30190, and has deployed it to all customer SIEM accounts to monitor exploitation attempts. Logz.io also suggests using Sysmon for process-level logging, despite its high data volume, and encourages customers to optimize this monitoring through its platform. The vulnerability's potential for long-term exploitation highlights the importance of vigilance and the anticipation of a future patch.

Logz.io is transitioning from using Kibana to OpenSearch Dashboards as its primary visual interface, following Elastic's decision to move away from a pure open-source license for Elasticsearch and Kibana. This shift is part of a larger commitment to open-source observability, with Logz.io actively participating in the OpenSearch project, a community-driven initiative led by AWS. The transition aims to combine open-source innovation with proprietary features, offering a scalable SaaS solution. OpenSearch Dashboards retain a familiar interface for users accustomed to Kibana while providing enhanced integration with numerous plugins for observability, alerting, and anomaly detection. This strategic move allows Logz.io to extend its product capabilities and supports users in creating custom extensions to meet unique needs. The company's dedication to an open-source, community-driven approach is seen as essential for the success of monitoring and observability tools now and in the future.