January 2024 Summaries

Compatibility testing is an emerging practice in software distribution that ensures applications can be successfully deployed across various combinations of Kubernetes distributions, versions, and configurations, such as OpenShift, EKS, and GKE. This testing is crucial for anticipating and resolving environment-specific issues before they impact customers, facilitating smoother deployments and reducing the need for extensive back-and-forth troubleshooting. By integrating compatibility testing into the CI/CD pipeline, software teams can confidently release new versions, knowing they will function correctly in diverse environments. This proactive approach not only improves customer satisfaction by preventing deployment issues but also streamlines internal processes, allowing teams to focus more on development rather than constant debugging. Replicated's Compatibility Matrix is highlighted as a tool that aids in implementing this strategy, offering solutions for vendors distributing software to self-hosted environments.

Replicated's Builders Plan telemetry provides a comprehensive framework for monitoring and reporting on customer software instances, offering insights into adoption metrics, installation performance, and customer usage patterns. The platform includes features such as Customer Overview and Instances Summary, which aggregate data to help vendors understand instance deployment and usage, as well as uptime data and event history to facilitate efficient debugging and issue resolution. It also supports custom metrics, allowing vendors to track specific usage patterns and react to changes, such as fluctuations in customer engagement or feature adoption. Additionally, Replicated is enhancing its capabilities to support air-gapped environments, ensuring that key insights can be gathered and analyzed even from isolated instances. Vendors are encouraged to become early adopters of these features to provide feedback and help shape ongoing improvements.

The January 2024 release highlights from Replicated introduce several enhancements and new features across their platforms, including a CVE-free version of KOTS and updates to the Compatibility Matrix, Vendor Portal, kURL, and Product Documentation. Key improvements include the ability to update the TTL for running clusters, enhanced cluster management through naming and tagging, and better visibility into application releases and customer license creation for vendors. The update also adds support for Kubernetes 1.29 and other software versions, along with improved documentation for managing resources in Helm charts deployed with KOTS. Additionally, vendors can now upload multiple support bundles at once and assign user-friendly names to instances, and the documentation has been updated to clarify the use of KOTS template functions and custom resources, further aiding vendors in software distribution to self-hosted environments.

Dexter Horthy discusses the evolution of DORA's "Four Key Metrics" for assessing software team effectiveness, highlighting the complexities of applying these metrics to customer-hosted software compared to SaaS applications. Replicated addresses these challenges with its Instance Insights feature, which provides crucial data for optimizing the lifecycle of customer-hosted applications, enabling vendors to understand key metrics like Age of Deployed Software and Time to Install. This tool offers visibility into version adoption trends and helps software teams set goals by visualizing adoption metrics such as unique versions and adoption rates. By leveraging these insights, independent software vendors can make informed, data-driven decisions regarding product roadmaps and resource allocation, thus enhancing their ability to manage customer-hosted environments effectively.

Replicated's new tool, the Compatibility Matrix (CMX), is designed to facilitate troubleshooting of failed deployments by creating ephemeral Kubernetes clusters. Evans Mungai, Sr. Customer Reliability Engineer, demonstrates its use by replicating customer environments to identify and solve deployment issues, particularly with KOTS applications. The process involves gathering customer information, checking configurations, and employing CMX to create various Kubernetes clusters to replicate the customer's environment and diagnose errors. Once the errors are reproduced locally, solutions can be tested and validated before advising customers. CMX streamlines this process by allowing quick creation and management of clusters across numerous distributions and versions without leaving the command line. The demonstration emphasizes the efficiency and versatility of CMX in resolving complex deployment issues and highlights its potential utility for Independent Software Vendors (ISVs) in supporting their customers.