October 2023 Summaries

Fivetran is a data integration platform that enables businesses to move data from various sources, such as business applications, operational databases, event streams, and files, into repositories like data warehouses and data lakes. This foundational capability underpins analytics across different domains, including reporting, dashboards, predictive modeling, machine learning, and artificial intelligence. By integrating data from disparate sources, Fivetran helps teams break down data silos and pursue higher-value uses of data to proactively answer important business questions and create innovative data products. The platform supports a wide range of data sources, including advertising platforms, marketing automation platforms, CRM/ERP/POS systems, accounting software, customer support applications, and more. Fivetran's data models can be used for various analytics use cases, such as campaign forecasting, financial forecasting, customer churn prediction, recommendation engines, natural language processing, and automated customer support. By combining data from multiple sources, businesses can create a coherent view of their operations, automate reports, and make data-driven decisions to drive business growth.

Fivetran was named dbt Labs' Technology Partner of the Year at Coalesce 2023, highlighting its best-in-class partnership with dbt. The company has over 1,000 mutual customers and is recognized for its investment in dbt as a technology. Fivetran and dbt are expected to continue growing together, with an upcoming release of their native dbt Cloud integration in January 2024. This integration aims to automate the orchestration of dbt Cloud jobs within Fivetran, increasing efficiency and reducing data latency. The partnership is seen as transformative for data teams, enabling them to focus on higher-impact projects and driving business-driven insights faster.

Generative AI has the potential to multiply the effort of creative and intellectual work by generating text, code, images, audio, and other media in response to prompts. It can assist with analytics, customer assistance, sales and marketing content, generate code to accelerate software engineering, and rapidly brainstorm new products and concepts. However, generative AI is limited by its lack of semantic understanding and contextual awareness, making it crucial to ensure the data used to train models is trustworthy and governed. Automation and accessibility are key features of modern data tools that enable efficient data transformation and modeling. A solid foundation of high-quality data underpinned by governance is essential for effective, safe, and ethical use of generative AI.

The journey of data migration and modernization is complex and requires a deliberate strategy to navigate its challenges. It involves balancing business needs with the complexity of the future, considering system dependencies, compounding complexity, and resource planning. Various approaches exist, including the "Lift and Shift" approach, which minimizes risk and disruption, while others like the "Optimization" and "Innovation" approaches focus on modernization, optimization, and full transformation. It's essential to stay outcome-focused, keep it simple, avoid supertools, balance business and technical considerations, automate processes, be realistic, transform in a new way, and prioritize modernization when feasible. Ultimately, the goal is to deliver faster business outcomes and higher value through a sustainable, service-based approach that doesn't require constant negative engineering oversight.

Fivetran offers multiple connection options to choose from for setting up a secure and efficient database connector, including direct connection, SSH tunnel, AWS PrivateLink, Azure PrivateLink, Google Cloud Private Service Connect, VPN tunnel, and proxy agent. The company provides various replication methods, such as log-based change data capture and log-free change data capture, depending on the location and operations of the database. To set up a successful database connector, users must gather required information from key stakeholders, including the database architect, security team, and database analyst or analytics team. Once the necessary details are collected, users can breeze through the connector setup process by selecting the connector, choosing the connection and update method, and clicking save and test to validate everything is correct. Fivetran provides an easy-to-use dashboard for each connector, allowing users to monitor recent syncs, user actions, alerts, logs, schema, usage, and setup details. The company's automated features, such as automated schema drift handling and automated resyncs in the event of a failure, ensure that connectors are up and running with a guaranteed 99.9% SLA, giving users pipeline peace of mind.

IDC's recent study on Fivetran customers reveals substantial benefits from investment in data tools, with an average ROI of 459% over three years. Participants achieved $3.6 million worth of benefits through increased staff productivity and business enablement. The payback period for Fivetran was only three months. Access to real-time data is crucial for staying competitive and innovative, and Fivetran's ability to unlock data for faster time to insight and improved decision-making has been demonstrated in various industries. Customers reported significant productivity gains across departments, with an average annual productivity benefit of $1.5 million. Additionally, companies using the Fivetran platform experienced operational cost savings and enhanced marketing capabilities. Overall, the IDC study showcases the impressive ROI, quick payback period, and long-term efficiency gains that Fivetran customers can expect.

Marketing teams are expected to spend approximately 14% of a company's budget in 2023, up nearly four percent from the last two years. With increased spending comes more data and responsibility to leverage that data effectively. One critical metric for understanding advertising campaign performance is Return on Ad Spend (ROAS). As a data engineer, you play a crucial role in unlocking advertising data for your organization. To calculate ROAS, divide the revenue generated from an advertising campaign by its cost. A high ROAS indicates that more customers are being acquired at a lower cost, while a low ROAS suggests fewer customers are being acquired at a higher cost. This metric helps marketing teams determine which channels and campaigns to invest in for customer acquisition. Centralizing advertising data is essential for obtaining accurate and reliable ROAS metrics. Without the support of a data team, marketers may have to manually pull numbers from various sources, leading to error-prone reporting and poor business decisions. Organizations with higher data maturity ensure that crucial data is validated and automated by their data teams. Fivetran simplifies the setup and maintenance process for building pipelines with appropriate endpoints to provide necessary metrics to query. The two primary data source types applicable are Advertising and Conversion. Common advertising platforms include Google Ads, LinkedIn Ads, Facebook Ads, TikTok Ads, and Snapchat Ads. Conversion sources depend on the company's sales type, such as Salesforce for B2B contracts or Shopify for B2C purchases. To set up a Fivetran connector for understanding ROAS, follow these steps: add the connector, authorize API access, configure data and select historical timeframe, complete connection tests, start initial sync, validate and standardize data across each new source in the destination, and leverage Quickstart data models to efficiently transform raw application data into analytics-ready tables. By connecting ad sources and conversion sources, you can compare advertising spend data with conversion metrics to understand what is driving customers to convert. Fivetran enables organizations to centralize their data, save hours of effort, and double their return on ad spend while scaling worldwide.

Fivetran has expanded its Microsoft Azure Cloud regions with new additions in the United States Central, Canada Central, and United Arab Emirates North. These new regions provide global support for companies running on Azure, bringing the total number of supported Azure cloud regions to seven. The latest expansion enables users to deploy Fivetran across the globe while meeting data residency requirements. Fivetran's multi-cloud infrastructure allows customers to easily deploy Fivetran on multiple clouds and orchestrate data between clouds, providing flexibility and control over their data movement. Additionally, Fivetran offers a Business Critical plan for Azure users with integrations that help achieve the highest level of security.

Financial transaction analytics is crucial for organizations to make informed decisions, but it requires a robust data stack. Transaction analytics helps predict and plan for the future by extracting insights from large volumes of financial transactions data. It sets the foundation for finance analytics projects such as financial reconciliation, revenue analysis, customer lifetime value and churn analysis. However, transaction analytics rely on databases due to their structured, sensitive and voluminous nature. Databases offer robust security features, real-time analytics and scalability, making them an excellent choice for safeguarding financial data. To unlock the true value of transaction data, pipelines need to be reliable, efficient, secure, user-friendly and well-documented. Fivetran offers a fully-managed solution that simplifies data integration, automates data movement and ensures 99.9% reliability, allowing users to focus on high-value data analytics and operational optimization.

dbt Labs' Coalesce 2023 conference is coming up and the company will be a Gold Sponsor, showcasing their expertise in data engineering and analytics at the event. They'll have a booth in the Activation Hall where attendees can learn about modernizing infrastructure with La-Z-Boy and Fivetran, as well as customizing dbt packages. The company will also host two speaking sessions, one on using La-Z-Boy and Fivetran to achieve impressive ROI, and another on utilizing and customizing Fivetran dbt packages. Additionally, they'll be hosting happy hours at FLOAT Rooftop and Punch Bowl Social San Diego, where attendees can network with the community. The company has also launched a User Group for dbt in the Fivetran Community, providing a platform for data professionals to interact with their analytics engineering team and influence dbt package development.