October 2023 Summaries

Sequin's first launch week introduced several new features and improvements aimed at enhancing data integration capabilities and developer experience. Stripe has become generally available as a new source, with a re-architected sync to address eventual consistency and support SQL Writes, allowing updates to customer subscriptions. GitHub was added as the fifth source, enabling read and write operations on repositories, pull requests, and issues, while cautioning against discrepancies in GitHub's API. Developer experience enhancements include schema downloads directly from the Sequin console and asynchronous migrations to prevent sync failures. Partnerships with app building platforms like Glide, Retool, and Superblocks were established to simplify app development, and a new feature, Sequin Events, allows users to subscribe to events from data sources via Kafka and webhooks. These developments mark the beginning of Sequin's efforts to create efficient, turnkey infrastructure for data integrations and app development.

Sequin, a company focused on streaming data from platforms like Salesforce, Stripe, and AWS, has developed a tool utilizing OpenAI embeddings to enhance search capabilities within GitHub repositories. This tool addresses the limitations of traditional text searches by employing semantic search through embeddings, which are vector representations that capture the relatedness of data. By integrating with Postgres using the pgvector extension, Sequin stores these embeddings and performs efficient similarity searches. The workflow involves generating embeddings for GitHub data, such as pull requests and commits, using OpenAI's API, and storing them in a database. To maintain up-to-date search results, Sequin employs event streaming through a serverless Kafka stream to handle updates and inserts. The tool effectively finds relevant GitHub objects based on user queries, allowing for more intuitive search results even with vague descriptions, although it may struggle with content-light entries. The project opens the door for further exploration into expanding search capabilities and utilizing embeddings for comprehensive analysis and reporting.

Sequin is introducing an alpha version of a highly anticipated feature called events, which allows users to handle data in motion by subscribing to events triggered when an API object is inserted, updated, or deleted. These events enable users to trigger workflows, upsert data into application tables, and sync data to other databases like MySQL, which Sequin does not yet support. Powered by Sequin-hosted serverless Kafka clusters, users have flexible options for consuming events, including connecting with a Kafka client library, using an HTTP interface, or setting up HTTP sinks for events to be POSTed to any destination. This flexibility allows for various applications, such as updating internal tables, triggering workflows, notifying other services of changes, and utilizing workflow tools like Make, Temporal, or Retool. Sequin plans to gradually roll out access to this feature, allowing users to explore new ways of building on synced data.

Sequin has introduced two new features and enhanced compatibility with app-building platforms to improve the user experience. Users can now directly download or copy schemas from the Schema tab, simplifying the process of using ORMs with Sequin-synced tables. Additionally, Sequin now performs asynchronous migrations, reducing sync failures caused by migration issues and allowing uninterrupted sync operations while providing error messages and email alerts for resolution guidance. With over half of Sequin users building internal tools, the company's collaboration with nine leading app-building platforms, including Retool, Glide, and Supabase, facilitates easy and efficient app development by offering seamless platform connections and comprehensive guides.

Sequin has introduced a new feature that allows users to sync their GitHub repositories, pull requests, and issues directly to a Postgres database, addressing a highly requested need from users. This integration simplifies workflows by enabling teams to use internal tools and streamline processes more efficiently, bypassing some of the limitations and complexities associated with GitHub's API, such as partial object returns and the need for webhooks. The integration also avoids the pitfalls of relying on Personal Access Tokens by allowing users to set up a more robust GitHub App for organizational use. A notable application of this feature is an OpenAI-powered search tool that facilitates semantic searches within GitHub data, demonstrating the potential for advanced data manipulation and retrieval. Users can now easily implement these functionalities by following the guidelines available in Sequin's documentation.

Stripe is now generally available as a new data source in Sequin, allowing developers to implement a real-time, two-way synchronization between Stripe and their databases, thereby centralizing billing information. This integration simplifies Stripe's integration process by reducing reliance on frequent API requests and complex caching strategies for subscription or invoice status checks. By storing billing data directly in the database, developers can manage, scale, and customize their Stripe integrations more efficiently, enabling the creation of custom billing solutions, subscription plans, and management tools. This advancement transforms Stripe interactions from complex API calls into straightforward SQL queries, enhancing app development beyond just building dashboards.

Sequin, a company that streams data from platforms like Salesforce to databases such as Postgres, is leveraging embeddings to enhance data search capabilities. By utilizing OpenAI's API, they convert customer data into vector representations, allowing for advanced semantic search rather than traditional keyword-based search. This method enables the identification of related content, such as customer feedback and product suggestions, by generating embeddings for Salesforce records and comparing them to a query's embedding. They employ tools like pgvector in Postgres for storing and querying these embeddings and use NATS for event streaming to ensure data updates are captured. Additionally, Sequin supports writing back to Salesforce, enabling the tagging and rating of notes, thereby facilitating improved product direction and customer engagement. This integration not only consolidates customer insights in a single platform but also offers a flexible and powerful alternative to Salesforce's native AI capabilities.