December 2023 Summaries

Robert Nishihara, CEO of Anyscale, highlighted a significant shift in the machine learning landscape during his keynote at AI.Dev, noting that developers, rather than ML experts, are now at the forefront of working with ML models. This shift reflects a change in approach where the focus is on developing and shipping products first, then customizing and optimizing models to fit market needs, leveraging general-purpose generative AI models like ChatGPT. The era is marked by the use of multiple models, including Retrieval Augmented Generation (RAG) and diverse agents that enhance LLM capabilities. Observability is key to iterating on features, as exemplified by Honeycomb's CEO Christine Yen, who shared insights on improving their Query Assistant feature. The conference also touched on challenges like evaluating the quality of generated responses, with companies like DeepChecks exploring solutions. The excitement in the tech field is palpable, as exemplified by Charles Herring's renewed enthusiasm sparked by ChatGPT, signifying broad new possibilities in tech exploration without needing deep expertise in model intricacies.

Honeycomb has launched an integration with Microsoft Teams to enhance the observability experience by making data more accessible and actionable within the popular workplace communication platform. This integration, part of Honeycomb's expanding suite of over 100 integrations, allows users to receive trigger alerts and Service Level Objective (SLO) burn rate notifications directly in Microsoft Teams, ensuring real-time connectivity and swift response to potential service issues. Setting up the integration is straightforward through the Integrations tab in Team Settings, and Honeycomb offers extensive documentation and support for users needing assistance.

Earlier in 2023, OpenTelemetry initiated efforts to stabilize HTTP Semantic Conventions, culminating in their announcement of stability in November by merging existing conventions with the Elastic Common Schema HTTP attributes. This change is set to standardize data formats for widely-used OpenTelemetry instrumentation libraries, ensuring compatibility with systems utilizing the ECS HTTP schema and enabling stable releases. However, it introduces significant attribute changes, including renamings, removals, and new additions, affecting Java and .NET services that will default to these stable values from December 2023. Users of these services are advised to prepare for the transition, as the changes could impact triggers, SLOs, sampling rules, and queries. To mitigate potential disruptions, OpenTelemetry and Honeycomb provide guidance on auditing and updating configurations, introducing environment variables for managing attribute emission, and centralizing updates. Although the transition may pose challenges, OpenTelemetry plans to support a migration period with continued updates and communication to users about the evolving process.

KubeCon/CloudNativeCon North America 2023, held in Chicago, highlighted the expansive growth and evolving focus of the cloud-native ecosystem, emphasizing that it now encompasses much more than just Kubernetes, with significant attention on platform projects like Argo CD, OpenTelemetry, and Backstage. The event's theme, "Architecting the Future," underscored the integration of AI into the cloud-native landscape, showcasing how AI is transforming software management and observability by enhancing efficiency and innovation. The introduction of the AI Hub and sessions on machine learning infrastructure highlighted the industry's forward-looking mindset. Contribfest sessions were particularly impactful, fostering community growth by mentoring new contributors to open-source projects. The event also underscored the importance of sustainability, with projects like OpenCost and Kepler focusing on financial and environmental sustainability. Ultimately, KubeCon celebrated the human element of the cloud-native community, emphasizing the connections and collaborations that drive continued innovation and adoption across diverse sectors.

KubeCon NA 2023 proved to be an invigorating experience for the attendees, featuring a diverse array of talks and panels that sparked significant excitement, particularly those on browser performance and observability during development. Participants, including six speakers and a panelist from the team, engaged with the OpenTelemetry community, sharing insights on topics like dynamic sampling, tracing for monoliths, and the OpenTelemetry Collector's advancements. The event was marked by both planned presentations and spontaneous interactions, fostering a sense of community and collaboration. Attendees navigated technical challenges during presentations and explored innovative approaches to software development and system performance. The event also included social activities like a Kubecrawl and an architectural tour, offering opportunities for informal networking and camaraderie. By the end of the week, participants left with a wealth of knowledge and new connections, deeming the conference a successful and memorable experience.

Improving web performance can be daunting due to the complexity of core web vitals and numerous standards, but OpenTelemetry offers a practical solution for browser performance observability by collecting data as users interact with websites or apps. Auto-instrumentation can measure key metrics like page load times, resource load information, and core web vitals scores, while manual instrumentation allows for tracking specific functions crucial to an app's functionality, such as an e-commerce checkout workflow. Adding context to the events collected can help pinpoint issues affecting particular user groups, such as mobile users on Firefox. Resources like a KubeCon talk and accompanying materials provide further guidance on using OpenTelemetry for effective browser performance debugging.