How Replicated uses the Compatibility Matrix to continuously test our KOTS installer releases on various K8s distributions and versions

Replicated has introduced a new Compatibility Matrix that significantly enhances the testing capabilities for its KOTS installer releases on a variety of Kubernetes distributions and versions, such as OpenShift, EKS, GKE, and AKS. Previously, testing was mainly conducted using K3s clusters, which, although fast and lightweight, did not fully represent the environments most customers use. With the Compatibility Matrix, Replicated can now run concurrent tests across multiple Kubernetes distributions, allowing for more comprehensive testing without increasing the overall testing time. This approach has streamlined the testing process, reduced the need for bespoke testing infrastructure, and provided greater confidence in the software's performance across diverse customer environments. The Compatibility Matrix also facilitates automatic integration of new distributions into the testing pipeline, further saving engineering time and allowing the KOTS team to focus on feature development.