Continuous testing and model selection with Lakera and Voxel51
Blog post from Lakera
Lakera has announced its integration with FiftyOne by Voxel51, enhancing the capabilities for evaluating and testing computer vision models. This partnership allows users to leverage FiftyOne's visualization tools to gain deeper insights into model predictions generated by Lakera's MLTest, facilitating easier model comparisons and selection. MLTest provides advanced functionalities that go beyond traditional metrics, including robustness and fairness assessments, and allows for detailed diff-like comparisons between models. The integration further enables users to conduct granular prediction-by-prediction analyses and deep failure analyses by clustering images based on model performance discrepancies. The setup process is user-friendly, with documentation and examples available to streamline onboarding.