July 2023 Summaries

011y Extract is a new feature designed to simplify the process of extracting insights from log data by automating the creation of regular expressions (regexes) using GPT technology. This tool addresses the common challenges associated with manually writing and maintaining regexes, which are essential for parsing and understanding raw, unstructured log data. By allowing users to generate regexes and intelligently assign field names with just a click, 011y Extract significantly reduces the time spent on log analysis, enabling quicker identification of issues such as latency in systems like Kubernetes-hosted applications. Additionally, users can create and publish new datasets for consistent log formatting, lessening their reliance on regexes and empowering less experienced team members to contribute to log analysis. Observe's 'schema on-demand' feature further enhances flexibility by allowing data to be shaped based on specific user queries without pre-ingestion structuring.

Organizations are increasingly integrating large language models (LLMs) like GPT into their operations, recognizing the productivity benefits while also facing significant security and data governance challenges. These concerns arise from the potential exposure of sensitive data when users interact with LLM features, leading some companies to implement temporary bans on their use. Training users to avoid inputting sensitive information is helpful but insufficient, as they may not always recognize what constitutes sensitive data. Logging and monitoring user interactions with LLMs can provide valuable insights into security risks and user needs, but organizations must ensure that third-party vendors are transparent about their data handling practices. While some companies may opt to develop their own LLMs to mitigate risks, this approach involves additional operational and security complexities. Tools like the Observe App for OpenAI offer visibility into API calls, helping organizations track the use of sensitive data. As LLM technology becomes more widespread, organizations must proactively establish policies for monitoring and managing user interactions to mitigate risks without relying on external regulatory frameworks.

Security observability is emerging as a crucial concept for organizations to manage risks and incidents more holistically, particularly for smaller organizations struggling with limited security resources. The analysis conducted by Observe reveals that smaller organizations often lack dedicated in-house security teams, instead sharing responsibilities across various roles and sometimes outsourcing. Larger organizations tend to invest more in security due to stringent compliance needs and a larger attack surface. The traditional SIEM approach, while rich in content and integration, often proves brittle and costly for smaller entities, highlighting the need for a more integrated and cost-effective solution. Security observability, leveraging concepts from observability, provides a promising alternative by integrating security with operational data, enabling organizations to monitor threats and manage security as part of their regular operations. This approach not only reduces costs associated with traditional SIEM systems but also enhances the ability to detect and respond to attacks, offering a more scalable security solution for organizations of all sizes.

Observe provides a suite of cost management tools designed to help organizations manage the financial implications of using the Observability Cloud, which operates on a usage-based pricing model. As businesses increasingly rely on cloud computing and microservices, they face rising data volumes and unpredictable failures, leading to potential cost spikes. Observe's tools, including the Usage Dashboard, Credit Manager, Acceleration Manager, and Acceleration Consent, offer detailed insights and controls over credit consumption, allowing users to monitor real-time usage, set budget limits, and adjust data freshness settings to balance cost and performance. These features aim to provide users with better predictability and control over their budgets without compromising the quality of observability services, ensuring that organizations can efficiently manage their expenses while maintaining data relevance and availability.