September 2022 Summaries

Convoy v0.6 introduces the capability to receive webhooks from providers like GitHub, Twitter, and Shopify, with special handling for provider-specific requirements such as Twitter's CRC check. The article offers a detailed guide on setting up GitHub webhook events, starting with signing in to the Convoy dashboard and creating an incoming project by securing a Project API Key. It explains creating a Convoy application and endpoint via API commands, detailing how to submit payloads and handle responses. The guide further explores creating a source with GitHub as the provider, establishing subscriptions to link sources, applications, and endpoints, and configuring GitHub to send webhooks for specific events like pushes and pull requests. Convoy facilitates the validation and distribution of events to subscribed endpoints, emphasizing reliability and replayability, and encourages feedback through its community channels.

The text discusses the choice of MongoDB for the Convoy project due to its flexibility with schemaless webhook events and effective JSON querying tools, while highlighting the unforeseen challenge of data migrations during software upgrades. It explores various migration solutions, such as golang-migrate, gormigrate, and goose, noting their limitations in compatibility with MongoDB when used in conjunction with Golang. The text details the shortcomings of ad-hoc scripts for open-source projects requiring reproducible upgrades and describes the custom approach inspired by gormigrate that was adapted to MongoDB. The author concludes by expressing intent to contribute this solution to existing migration tools and invites feedback on the article's content.