July 2022 Summaries

Version 8.3.3 of the Elastic Stack has been released, and users are encouraged to upgrade to this latest version over previous patch versions in the 8.3.x series. The release includes fixes and changes across various components of the Elastic Stack, such as Elasticsearch, Kibana, Beats, Logstash, Elastic Enterprise Search, Elastic Observability, APM, and Elastic Security. For detailed information about the issues addressed and the specific changes made in each product, users should refer to the 8.3.3 release notes.

Elastic's solutions are empowering financial services organizations to enhance customer experiences, boost IT visibility, and strengthen security measures according to a study conducted by Socratic Technologies. The study highlights the significant role of Elastic Enterprise Search in reducing customer churn, improving web conversion rates, and increasing employee productivity by enabling fast and relevant search experiences. Elastic Observability is shown to improve operational intelligence by offering a centralized view for managing complex IT ecosystems, thereby increasing productivity and reducing costs. Furthermore, Elastic Security plays a critical role in mitigating risks, with respondents reporting a 72% reduction in the risk of data breaches. Elastic Cloud offers seamless deployment and management across multiple cloud environments, enhancing the value of Elastic's products with cloud-native features and compliance with industry standards like PCI DSS.

The article by Gustavo Llermaly outlines a method for parsing body text into Elastic App Search, particularly when dealing with websites that have custom structures. Elastic App Search typically extracts text based on HTML tags into predefined fields, but this can be limiting when specific fields need to be captured, such as product details. To address this, Llermaly suggests creating a proxy server that interacts with the website's crawler requests, allowing custom meta tags to be injected into the response. This process involves setting up a NodeJS server to host a product page and a proxy server that modifies the page to include meta tags, enabling App Search to recognize these custom fields. The approach enables developers to manage and parse custom website data effectively without altering the original site structure.

Managed Detection and Response Services (MDRS) offer enhanced security capabilities compared to traditional Managed Security Service Providers (MSSPs) by focusing on deeper infrastructure monitoring and threat response with tools like Elastic XDR and Corelight. Elastic's platform integrates security information and event management (SIEM) and endpoint security, providing a unified solution for prevention, detection, investigation, and response. Corelight enhances network security monitoring by leveraging Zeek to transform network traffic into actionable metadata. For deploying Elastic's solution, options include self-managed or fully managed Elastic Cloud, with considerations for dedicated versus shared clusters to maintain performance and security. Architecture best practices for MDRS include segregating customer environments for better scalability and using cross-cluster search for centralized rule management. The integration of Corelight data with Elastic empowers threat hunting and investigation while maintaining cost efficiency. Elastic's recent licensing changes impact the provision of its products as managed services, and further details are available in their licensing FAQs.

CFOs and CIOs have compelling financial incentives to collaborate on cloud migration strategies, as early adopters of cloud technology stand to gain a significant financial edge, potentially capturing a share of a $1 trillion opportunity by 2030, according to McKinsey. Companies like FedEx are already moving towards cloud-native structures, anticipating substantial annual savings. The cloud offers multiple benefits, including increased productivity, improved application development and maintenance, enhanced security with reduced downtime, accelerated product development, and the ability to scale rapidly. Additionally, cloud migration facilitates digital transformation by optimizing processes and enabling experimentation with minimal risk, while also providing advanced analytics to inform strategic planning. Prioritizing security and leveraging digital processes can unlock further efficiencies, making it crucial for organizations to effectively invest in training and reskilling their workforce to harness the full potential of cloud capabilities.

The convergence of information technologies (IT) and operational technologies (OT) is central to the Industry 4.0 vision and has been accelerated by the COVID-19 pandemic, prompting manufacturers to reevaluate their priorities for increased productivity and innovation. Key trends include improving supply chain visibility through cloud-hosted data for agile responses, driving intelligent automation at scale with technologies like 5G and machine learning to enhance predictive maintenance and quality management, and closing cybersecurity gaps by adopting sophisticated access management and security standards. Despite challenges such as skilled labor shortages and the rise of remote work preferences, the digital transformation in manufacturing is accelerating, with a growing emphasis on adopting multifaceted platforms that support evolving business needs.

Elastic Observability, built on the Elastic Stack, is a widely deployed platform that offers end-to-end visibility into applications, systems, and infrastructure, significantly improving resilience and reducing application downtime. Insights from a survey of over 1,400 Elastic customers reveal quantifiable benefits such as a 66% improvement in MTTx metrics, a 61% reduction in incidents, and a 62% reduction in revenue loss due to downtime. The platform's unified visibility enhances collaboration across teams, driving higher customer satisfaction and reducing churn by up to 90%. Elastic Observability also accelerates time-to-market for new products by up to 88%, supporting operational efficiency and cost-effectiveness, particularly when deployed on the cloud. These capabilities allow businesses to adapt to technological advances and maintain seamless operation of critical services at scale.

Elastic Cloud offers a cost-effective solution for utilizing Elastic, with several strategies available to optimize resource consumption and reduce costs. These strategies include using searchable snapshots and data tiers to manage storage costs effectively, upgrading to version 7.15 or higher to decrease data transfer costs, and selecting the appropriate hardware profiles to achieve better price-performance ratios. Additionally, auto-scaling policies can be implemented to ensure efficient resource use as demand fluctuates, and starting with monthly billing allows users to determine the optimal configuration for their specific needs. By leveraging these approaches, Elastic Cloud users can manage expenses without a proportional increase in costs relative to usage growth.

The Elastic Enterprise Search team has introduced a new project called the Elastic Enterprise Search Connectors framework, which allows users to create or customize connectors to ingest data from third-party services into Workplace Search. Initially appearing as a Technical Preview in version 8.2 and expanded in version 8.3, the framework provides boilerplate code and connector packages to streamline development, enabling users to harness the power of Elasticsearch for comprehensive document search across various sources. While Workplace Search offers a catalog of connectors for popular services, the framework addresses gaps by allowing custom connector development, exemplified by a GitLab connector tutorial. This framework simplifies the development process by utilizing Enterprise Search’s synchronization model for managing data ingestion, updates, and deletions. Users can engage with the open-source project to influence its evolution, with the potential for wider adoption as the framework progresses toward general availability.

Version 8.3.2 of the Elastic Stack has been released, addressing key issues from previous versions, particularly a significant Kibana alerting problem where rules created or edited in version 8.2 stopped running after upgrading to versions 8.3.0 or 8.3.1. Users who have already upgraded to these versions need to manually resolve the alerting issues by following specified steps. This latest release is recommended over previous patch versions in the 8.3.x series, and comprehensive details about the fixes and changes can be found in the 8.3.2 release notes.

Elastic Cloud offers a flexible pricing model based on the resources consumed rather than individual products or use cases, allowing users to apply its search-powered platform across various solutions such as enterprise search, observability, and security. This consumption-based billing model enables customers to pay only for the actual infrastructure resources used, such as virtual storage, RAM, and vCPUs, depending on the chosen hardware profile tailored to their specific use case. Elastic’s approach eliminates the need to pay for multiple products, ensuring simplicity and scalability as users can add data sources and expand their applications without altering their contracts. Costs also include data transfer and storage, with the flexibility to adjust data tiers for performance and cost savings. Customers can start with a monthly billing model or opt for pre-paid cloud credits to manage spending predictably, benefiting from volume discounts and integrating with existing cloud spending commitments.

Elastic Enterprise Search is a crucial tool for organizations aiming to address the complexities of locating information amid increasing data volumes and tool sprawl. A customer study conducted by Elastic and Socratic Technologies highlights its effectiveness in enhancing customer satisfaction through fast, relevant search experiences, which lead to increased transactions, improved conversion rates, and reduced cart abandonment. The platform also boosts employee satisfaction by enabling efficient information retrieval, accelerating onboarding, and fostering collaboration, with a reported 69% increase in employee satisfaction. Elastic's innovative features, such as integrated security capabilities and graph analytics, empower developers and non-technical staff to enhance search functionality. Additionally, Elastic Cloud offers seamless deployment in public or multi-cloud environments, providing reduced service disruptions and overhead costs. Overall, Elastic Enterprise Search is praised for its ease of use, reliability, and the value it brings to organizations by maintaining in-house expertise and reducing agent turnover.