September 2022 Summaries

Sequin, a tool designed to manage API quotas, has introduced new rate limit controls to give users greater command over their integration's API usage. This feature allows users to set the number of API calls their integration uses, aiming to tackle the challenges posed by API rate limits, such as the need for logic to track and pace calls, as well as caching and batching complexities. By setting these limits, Sequin ensures that integrations stay within their allocated API call limits, dynamically prioritizing and batching requests to maintain efficiency. Additionally, upcoming features will include batching controls, table-level priority settings, and a sync speedometer to help users optimize integration efficiency and speed based on changing API allocations and priorities.

Sequin, a company that streams data from platforms like Salesforce, Stripe, and AWS, initially sought to utilize Salesforce's /updated endpoint to efficiently retrieve recently updated records using caller-defined time intervals. However, challenges such as API rate limits, a 30-day restriction on start dates, and the need for flexibility led them to pivot towards using the /query endpoint, which allows for more powerful and versatile SOQL queries. This approach enables Sequin to fetch records with greater flexibility, avoid duplicate data, and manage customer syncs more effectively, using techniques such as FIELDS(ALL) to retrieve all fields and incorporating conditions like LastModifiedDate to ensure comprehensive data retrieval. Additionally, the /query endpoint facilitates related data extraction and handles deleted records efficiently, offering a consistent strategy for pagination and data management across various call types.