May 2023 Summaries

Pulumi has introduced enhancements to its Cloud Webhooks, focusing on improved integration with Slack to streamline deployment notifications for teams. This update allows users to receive deployment notifications directly in their Slack workspaces, enhancing team visibility and reducing context switching. The new Slack integration simplifies the process by eliminating the need for customers to host infrastructure, and it is available to all Pulumi Cloud organizations. Additionally, Pulumi has expanded event notification types and filters, allowing for more precise control over which events trigger notifications. The platform now supports Slack-formatted webhooks and offers Pulumi Cloud REST API endpoints and Pulumi Service Provider support to facilitate large-scale webhook setup. These enhancements aim to improve response times to critical issues and integrate deployment notifications seamlessly into existing team workflows.

Pulumi has introduced several enhancements across its engineering areas in March and April, improving both the Pulumi CLI and Pulumi Cloud. Key updates include the addition of project-scoped stacks to self-managed backends, an improved interactive scrolling experience, and a new keyboard shortcut to view updates in a web browser. The CLI now supports a flag to specify teams for newly created stacks and provides visual indications for retained resources. Additionally, enhancements have been made to the Pulumi Automation API, including the ability to manage stack tags and full support for the "Who Am I" command. Pulumi Cloud has seen improvements in resource search, with more advanced filtering options and support for Pulumi Teams, as well as updates to the events dashboard and stacks page icons. Meanwhile, cloud providers and packages, including Azure, AWS, and Kubernetes, have received updates, and two new community packages have been added to the registry. There is also a new SAML Admin role for enterprise customers, enhancing authentication options.

PulumiUP is a virtual conference dedicated to the Pulumi community and enthusiasts of Infrastructure as Code (IaC), featuring technical talks, demos, and insights from industry leaders to enhance cloud engineering skills. Attendees can expect to learn about the latest features in Pulumi's IaC SDKs and Pulumi Cloud, with hands-on demonstrations by key figures like Joe Duffy and Luke Hoban. The event showcases talks from various experts, including Sam Cogan on keeping infrastructure code DRY, Dennis Sauvé on software engineering modernization, and Ala Shiban on transforming code to be cloud-native. A panel discussion moderated by Joe Duffy will explore AI's impact on cloud development, featuring industry experts like Amanda Silver and Beyang Liu. The conference is supported by partners such as AWS, Google Cloud, and Microsoft, who will provide tech talks and demos on utilizing their platforms effectively. Participants will have the opportunity to engage with innovators, gain insights on cloud automation, and explore modern software delivery practices.

The blog post is part of a series on Infrastructure as Code (IaC) best practices, focusing on role-based access control (RBAC) and security in managing Pulumi projects for Zephyr Archaeotech Emporium, a fictional company. As Zephyr expanded, they restructured their Pulumi projects and stacks to enhance security and scalability, employing RBAC in Pulumi Cloud to control access and uphold the principle of least privilege. The post emphasizes using Pulumi Cloud's RBAC functionality by setting default stack permissions to Read or None and assigning team permissions to ensure minimal access necessary for job responsibilities. It recommends managing RBAC configurations declaratively using the Pulumi Cloud provider, utilizing the --teams flag for stack creation, and allowing users to create their own stacks to avoid bottlenecks in provisioning cloud infrastructure. The post illustrates how Zephyr implemented RBAC to manage access across different teams and projects, ensuring controlled and efficient resource management.

Pulumi AI leverages large language models to simplify the discovery, learning, and utilization of cloud infrastructure APIs, acting as a guide through the dynamic cloud landscape by providing tailored solutions. Recent enhancements include integrating Pulumi Package schema data, which improves the accuracy and relevance of generated Pulumi programs by overcoming limitations such as outdated provider knowledge and the risk of generating non-existent APIs. Despite the challenge of schema data size exceeding the capacity of current generative AI context windows, a new approach was devised to select and inject relevant schema information, enhancing Pulumi AI's accuracy and responsiveness without increasing latency. These improvements allow Pulumi AI to generate more precise infrastructure as code solutions, such as creating EKS clusters or deploying static websites on Azure, and reference up-to-date resources like Google AlloyDB. As Pulumi AI continues to evolve, it aims to empower users through features like interactive documentation and shareable conversation links, contributing to the broader field of AI research and cloud engineering.

Pulumi has introduced a new feature, Resource Search, to its Pulumi Cloud platform, which has quickly become the fastest adopted feature since its launch. This tool addresses a common challenge faced by organizations: the difficulty of obtaining a comprehensive view of resources spread across multiple cloud accounts and providers. Resource Search allows users to conduct multi-cloud searches and analyze cloud usage data, offering insights such as statistics on cloud consumption by provider and department. The feature has been enhanced with advanced filtering options and Pulumi Teams support, enabling users to refine search results and manage resources by team access. Additionally, it includes a query syntax for interactive infrastructure discovery and an AI Assist for generating query syntax. Pulumi also offers a Search API for integrating search functionality into internal systems and workflows, and plans to provide data export capabilities in the future. This tool is available for free to all Pulumi users, facilitating easier management of cloud resources and infrastructure insights.

Danny Zalkind, the Senior Director of Infrastructure Engineering at Skai, shares insights into Skai's migration of their critical data to AWS using Amazon Keyspaces, facilitated by Pulumi and AWS Lambda. With a focus on enhancing marketing efficiency, Skai shifted from a 100-node Apache Cassandra cluster to a serverless, scalable, and cost-effective cloud solution, aiming to minimize infrastructure maintenance. The migration employed a dual-write method to ensure data integrity, utilizing a Lambda function for periodic data comparison between the new and old systems. By decoupling application code from infrastructure provisioning, Skai leveraged Pulumi to automate resource creation, allowing Skai's R&D teams to concentrate on code delivery through their CI/CD pipeline. The successful migration resulted in a 50% reduction in backend process runtime, a 400% increase in event processing throughput, and a 30% decrease in team time spent on infrastructure maintenance, offering a blueprint for large-scale cloud database migrations.

Pulumi has established Pulumi User Groups (PUGs) on Meetup to foster a global and local community where users can connect, exchange knowledge, and stay informed about Pulumi and cloud infrastructure developments. These groups offer access to a network of experts and conduct regular events such as meetups, webinars, and workshops, both in-person and virtual. Currently, there are 23 PUGs across 10 countries, led by Pulumi employees and passionate community members known as Puluminaries, who are experts in cloud infrastructure and related topics. The inaugural in-person PUG meetup in London featured talks by industry experts, including Pulumi's Co-Founder & CEO Joe Duffy, and was well-received by attendees. Pulumi plans to continue expanding these community efforts, offering more opportunities for professionals to engage and share best practices in the field.