Home / Companies / Fivetran / Blog / Post Details
Content Deep Dive

Serverless ETL With Cloud Functions

Blog post from Fivetran

Post Details
Company
Date Published
Author
George Fraser
Word Count
770
Company Posts That Month
1
Language
English
Hacker News Points
-
Post removed?
No
Summary

Fivetran introduces a cloud-functions connector for syncing custom data sources into a data warehouse. The process involves writing a tiny function that fetches data from the custom source and hosting it on a serverless computing platform like Google Cloud Functions, AWS Lambda or Azure Functions. Fivetran calls this function every 15 minutes to fetch new data, deduplicates it, and merges it into the warehouse. The cloud-functions connector supports custom APIs, obscure APIs with few users, and data formats that are not self-describing like Protobuf.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
Secrets Management 7 18 8 7 -83%
Serverless 5 105 28 19 +12%
Data Pipeline 2 54 22 13 +116%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.