October 2022 Summaries

ML observability is an essential part of the MLOps toolchain that helps teams automatically surface and resolve model performance problems before they negatively impact business results. It enables retraining workflows by tracking prediction drift, concept drift, and data/feature drift to know immediately if a model is drifting due to changes between the current and reference distributions. This allows for more efficient model updates and minimizes the risk of introducing new biases or issues. Model version control provides side-by-side analysis of how each version of a model performs, enabling teams to evaluate the efficacy of their optimizations and retraining efforts. Deprecating models is crucial to prevent regression errors and ensure reliable ML environments in production. Fairness checks and bias tracing are critical for determining whether models are exhibiting algorithmic bias, while data labeling can help detect changes in new patterns that emerge in unstructured data. By implementing ML observability best practices, teams can ensure a solid foundation for future success in MLOps.

Arize AI recently hosted an event with the Canada chapter of Women of AI, a global nonprofit dedicated to increasing female representation in AI and machine learning. The panel discussion covered various topics, including personal journeys into the field, advice for women aspiring to pursue careers in AI, and the importance of networking and self-preparation. Panelists discussed their diverse paths into AI, from software engineering and astronomy to postdoc research and recruiting. They emphasized the need for passion, preparation, and a willingness to take calculated risks in order to succeed in the field. The discussion also touched on issues such as pay equity, talent retention, and the differences between big tech companies and startups. Overall, the event aimed to provide valuable insights and advice for women looking to break into the AI industry.