February 2024 Summaries

The digital marketing industry has been shifting towards a greater focus on data privacy, including regulations like GDPR and CCPA, alongside an emphasis on data science and AI in analytics. A full-service agency like Tinuiti is leveraging modern approaches to build its data stack, enabling easy access to data from various platforms and sources, which is crucial for scaling data products. With the help of a platform like Fivetran, Tinuiti can efficiently collect and synthesize data to derive strong client outcomes, while also improving predictive analytics capabilities through data lakes.

Alation's Fivetran open connector framework (OCF) connector is designed to provide end-to-end cross-system lineage for business users, enabling them to understand the source data and see where and what changes have occurred. The connector intelligently adds lineage metadata via Fivetran and dbt Labs to cataloged data sources, providing a consolidated view of the data pipeline and its transformations. This solution helps solve the challenge of end-to-end lineage in modern data stacks, empowering data analysts and engineers to collaborate effectively and ensure adherence to data governance best practices. The connector provides insights on end-to-end cross-system understanding, transformations, and a consolidated view to troubleshoot pipeline issues or assess change impact efficiently. By combining Fivetran's data pipeline concierge capabilities with dbt's transformation and refinement tools, Alation's platform offers improved data accessibility, quality, and governance, empowering data analysts to make better decisions and ensure a thriving data culture.

The partnership between Fivetran and Databricks enables users to integrate data by automating data movement, removing the need to build data pipelines manually. The combination of automated data integration with the power of the data lakehouse architecture provides a versatile and user-friendly package that offers flexibility in deployment options, data residency control, and cost-effectiveness. Fivetran's partnership with Databricks allows users to easily construct front-to-back data integration using SQL-based transformations and data visualizations, making it accessible through the Databricks Workspace UI. The setup process involves navigating menus, either through Databricks Partner Connect or Fivetran directly, and requires supplying credentials for each source, setting a schedule, and configuring connectors to make initial syncs. Once data is available, users can access it through the Catalog Explorer, SQL Editor, and create dashboards with visualizations by selecting queries.

Fivetran enables organizations to access large volumes of data necessary to train AI models by providing a simple workflow for integrating data from various sources into a central repository. This allows for the combination and analysis of schemas from disparate sources, making it easier to build generative AI models such as retrieval-augmented generation (RAG). RAG consists of supplementing an existing generative AI model with additional facts and context to produce more factual and relevant outputs. Fivetran supports integration of large bodies of text within structured data from various sources, including GitHub, Salesforce, and Zendesk, making it a practical option for organizations looking to leverage the power of off-the-shelf generative AI. By utilizing Fivetran's governed data lake or repository, organizations can add modularity to their architecture, allowing them to easily change vector embeddings and chunking strategies without resynchronizing all data from sources. The process also involves embedding raw data as numerical representations called vectors in a vector database, which can be attached to user prompts and sent to a foundation model for more accurate and relevant answers.

Master Data Management (MDM) is essential for organizations to centralize and maintain consistent, accurate master data, creating a single source of truth for entities like customers, products, and vendors. MDM enhances data quality, operational efficiency, and regulatory compliance by integrating data governance, quality management, integration, security, and continuous monitoring. Companies like Red Wing Shoes and IBM have successfully implemented MDM to improve operational efficiency and customer personalization, respectively. Future trends such as artificial intelligence, machine learning, and cloud-based solutions are shaping MDM by automating processes, enhancing scalability, and ensuring data integrity, while emerging technologies like blockchain are being explored to bolster data security. As organizations harness these advancements, they can unlock the full potential of their master data, driving strategic decision-making and offering enhanced customer experiences.

The fitness industry has undergone significant transformation post-COVID, with people seeking more holistic approaches to health and the ability to work out on their own terms. This has led to a growing global wellness industry worth at least $1.5 trillion. In response, companies like BODi have adapted their data strategies to deliver personalized customer experiences. Aarthi Sridharan, Vice President of Data Insights and Analytics at BODi, shares her experience building a data foundation for the company's Customer 360. Key lessons from this transformation include securing buy-in from leadership, planning a phased approach, staying flexible to adapt to changing requirements, and accounting for more time for data validation.

The tech industry has seen a surge in AI development following OpenAI's release of ChatGPT last year, with companies like Microsoft and Google investing heavily to catch up. The boom in AI has led to the creation of new roles, such as senior executives in charge of AI, and is expected to continue with emerging trends in 2024 and beyond. Personalized AI systems trained on individual user data are likely to become more prevalent, offering highly personalized experiences and insights. Data integration tools will be crucial for enterprises to centralize data from diverse operational data stores and build a corpus to train AI on. Governance and regulation of AI are becoming increasingly important as companies focus on ensuring data quality, compliance, and security. Domain-specific, specialized models will rule the enterprise, offering greater accuracy and efficiency in applications. Open-source models are closing the gap with commercial counterparts, making advanced tools more accessible. Regulations and compliance are taking hold, with governments and businesses focusing on regulating AI to mitigate risks. Data lakes are gaining popularity as large enterprises recognize their need for housing unstructured and semi-structured text data needed for AI. Finally, fine-tuning models is becoming significantly easier thanks to new AI platforms that abstract away complexity, making model customization more accessible.

The MarTech landscape is rapidly evolving with an 11% growth rate since last year, driven by a 7,258% increase since 2011. Despite this growth, only half of marketing decisions are data-driven, indicating a disconnect between investments and ROI. Common obstacles to unlocking insights include data silos, manual data aggregation, custom-built pipelines, and a disconnect between analytics and data science tools. To overcome these challenges, organizations need an AI-powered Modern Data Stack built on the Data Intelligence Platform, which automates processes, efficiently sifts through marketing data, and provides a unified foundation for all data governance. This enables marketers to unlock customer experiences, improve effectiveness, and unleash greater efficiency, ultimately driving business success.

Fivetran has been recognized as a Strong Performer in The Forrester WaveTM: Cloud Data Pipelines, Q4 2023, citing its strengths in data transformation and quality, as well as its wide range of connectors and hybrid cloud environment. The platform received high scores for ease of use, price-performance, automation, and support for various data sources. Fivetran's enterprise-scale platform has been adopted by thousands of companies worldwide to power data-driven business decisions and generative AI workloads, with customers such as Dropbox benefiting from its improved data ingestion and reporting times.

Rocket Software has built a modern data foundation to support predictive AI by implementing Fivetran for data integration, allowing them to scale and reduce costs. The company plans to use predictive AI to forecast customer churn with accuracy and lead time, ultimately improving operational efficiencies and potentially implementing personalization for customers in 2025. With over 15 years of experience building data teams across industries, Senior Director of Data and Analytics at Rocket Software Parag Shah is betting big on predictive AI in 2024.

We are excited to announce the release of our newest integration with dbt Cloud, allowing you to orchestrate dbt Cloud jobs right from Fivetran’s platform. This integration enables data teams to manage all stages of data integration – extraction, loading and transformation – through one platform with minimal engineering effort. Fivetran's integrated scheduling for dbt Core was previously launched in 2022, providing a solution for orchestrating open-source, self-hosted dbt data transformations. The new dbt Cloud integration offers a fully managed experience, allowing teams to avoid provisioning infrastructure while taking advantage of collaborative web-based development and navigation through a web UI. Analysts and engineers can now schedule dbt Cloud jobs to run upon the successful load of new data from associated upstream connectors, set up, monitor and QA pipelines directly from the Fivetran GUI with robust run logs. The integration simplifies data pipeline setup and maintenance, helping data teams reprioritize their attention while democratizing access to data and making it simpler and more reliable to use. With this integration, data teams can now manage end-to-end ELT pipelines with built-in choice, allowing them to focus on data work versus pipeline management. Getting started is dead simple, requiring only navigating through menus and authenticating an account. The new integration brings a single environment where reports and dashboards can be set up in minutes, further underscoring Fivetran's commitment to providing a central platform that acts as a data foundation.