A guide to implementing AI data pipelines
Blog post from dbt
Stephen Thibeault's guide addresses the disparity between AI adoption in coding and data pipeline management, as highlighted in the 2026 State of Analytics Engineering report, noting that 72% of teams prioritize AI for coding while only 24% do so for pipeline management. The guide explores why AI pipeline management lags, emphasizing that while AI-assisted coding is often an individual task, pipeline management requires team collaboration and alignment, making it more complex. Thibeault suggests layering AI onto existing ELT data architectures without overhauling them, focusing on high-value areas like code reviews, error triage, and ticketing systems to integrate AI into workflows effectively. The guide encourages starting with low-stakes use cases, piloting AI implementations, and continuously evaluating and maintaining AI systems to ensure they remain reliable and effective. It also stresses the importance of organizational buy-in from leadership to integrate AI meaningfully into daily workflows, with realistic expectations about the pace of efficiency gains and the necessary work to make AI systems trustworthy.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| LLM | 5 | 6,942 | 1,215 | 234 | +11% |
| Data Pipeline | 4 | 509 | 182 | 74 | +1% |
| AI Coding Assistant | 3 | 1,487 | 422 | 149 | -31% |
| AI Agents | 1 | 5,827 | 1,275 | 245 | -5% |
| MCP | 1 | 7,621 | 787 | 203 | -1% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.