October 2018 Summaries

Fivetran has announced its partnership with HubSpot, a leading inbound marketing platform. This collaboration aims to help businesses make data-driven decisions by replicating data into cloud warehouses from various business applications, including HubSpot. Both companies share similar goals and are focused on providing transparent and trusted services for businesses that rely heavily on data. Fivetran is offering a free trial of its HubSpot connector to interested users.

Fivetran offers an automated email connector that can directly load CSV and JSON files into your data warehouse, saving time and effort by eliminating manual uploads. The Email Connector works with various business applications that produce CSV or JSON files and scheduled reports. It is designed for ease of setup and use, allowing companies to analyze their data without wasting human capital on manual uploads. Fivetran's technology supports agile analytics, enabling data-backed decisions across organizations.

The text provides a detailed guide on setting up a cloud function connector using Python and Google Cloud Platform Functions to extract and process data from APIs not natively supported by Fivetran, such as Yelp's business search API. It emphasizes the utility of cloud function connectors for handling custom or obscure APIs by allowing users to write scripts hosted on a serverless platform, enabling automatic syncing and deduplication similar to standardized Fivetran connectors. The guide assumes familiarity with Python and API data ingestion, outlining the steps to obtain necessary API credentials, write and deploy the function script using Flask, and integrate it with Fivetran by setting up a Google Cloud Function connector. It also explains how to structure the data in a relational schema to manage many-to-many relationships, such as those between businesses and categories, and provides insights into testing the function and accessing the data warehouse for further analysis.