March 2023 Summaries

The stable release of Convoy v0.9 introduces significant improvements, including a migration to PostgreSQL as the default datastore, integration with message brokers like Amazon SQS and Google PubSub, a revamped client CLI, and an enhanced Dashboard experience. The transition from MongoDB to PostgreSQL addresses previous challenges with schema and data migration, transaction support, and query optimization, resulting in a faster API and Dashboard. The integration with message brokers enhances the reliability of webhook event delivery by leveraging the stateful nature of services like SQS and PubSub, bypassing the need for complex HTTP-based systems. The new Client CLI is designed for better usability in local debugging, and the Dashboard now features a streamlined onboarding process and improved form usability. Looking ahead to Convoy v0.10, planned features include Kafka integration, Webhook Idempotent Keys, Meta Events, and a release candidate for the Enterprise Edition with Role-Based Access Controls.

Convoy, an open-source webhooks gateway designed for scalability and multi-tenancy, has re-launched its client CLI tool with improved documentation to enhance user experience. The new approach resolves previous issues with intuitiveness by separating the server and client functionalities into two distinct binaries: 'convoy' for the server and 'convoy-cli' for the client. This change addresses the confusion caused by the initial implementation, where commands were dependent on different configuration files. For incoming projects, users can now authenticate and debug events locally using personal access tokens, while outgoing projects will rely on OAuth for improved intuitiveness. The setup process for the convoy-cli involves installation via Homebrew, starting the stream server, and logging in with a Personal API Key to access and manage projects. Detailed steps and commands are provided for users to listen and debug webhook events locally, with further documentation available for deeper guidance.

Platform engineers face several challenges in adopting webhooks gateways like Convoy, primarily due to security concerns, cost considerations, integration complexities, and a lack of awareness. Security issues such as man-in-the-middle and replay attacks make engineers cautious about using third-party gateways, although Convoy offers features like endpoint authentication and payload signing to mitigate these risks. Cost efficiency is a priority, especially in a bear market, and Convoy addresses this by offering a free version and competitive pricing. Integration readiness can also deter adoption, but Convoy facilitates quick setup and provides community support to ease this process. Furthermore, many engineers are unaware of the potential benefits and features of webhooks gateways, prompting Convoy to produce educational content to raise awareness. Resistance to change is another barrier, as engineers accustomed to manual webhook management may be hesitant to adopt new platforms, though Convoy aims to streamline these processes and improve efficiency for larger organizations.

In the latest update from Convoy, several key developments were highlighted, including the release of Convoy 0.9 RC, which now supports webhook event ingestion through Google Pubsub and Amazon SQS, offering more options beyond HTTP. The onboarding dashboard received updates to enhance user experience, providing clearer instructions for setting up ingestion and project creation. A significant infrastructure change was the migration from MongoDB to PostgreSQL, discussed by Convoy's CTO and CEO during a launch event. The update also mentioned new blog content for platform engineers, covering topics like webhooks with message brokers and webhook gateways. Looking ahead, Convoy's public roadmap outlines forthcoming features such as the stable release of Convoy 0.9, the introduction of Community and Enterprise Editions, and idempotent keys for webhooks. Readers were encouraged to engage with Convoy on GitHub and Twitter for more updates.

A webhook gateway is a tool that manages the flow of webhook events between providers and consumers, offering features such as reliable delivery, routing, security, and scalability. Convoy, an open-source webhook gateway, provides solutions for common challenges like failed webhook deliveries due to factors like network issues or expired SSL certificates, by implementing retries, circuit breaking, rate limiting, and timeouts. It facilitates routing in microservices and integrates with message brokers like Google PubSub and Amazon SQS to handle asynchronous communications, providing static IPs for secure connections. Additionally, Convoy offers monitoring, alerts, and a user-friendly interface for debugging, and supports geolocation-based routing and versioning to accommodate evolving API signatures. By enabling these capabilities, Convoy helps platform teams manage webhooks efficiently without needing deep involvement from developers in the webhook implementation, allowing them to focus on core business products.