Shutterstock
Analytics engineering emerged alongside probably the most important technological revolution of the previous decade – the rise of cloud computing. As we speak, we’re experiencing even a better transformation, one fueled by the meteoric rise of synthetic intelligence (AI), which is reshaping how analytics engineers strategy knowledge challenges
AI has shortly turn into an integral a part of the day by day workflows for 80% of knowledge professionals, up from 30% final 12 months. It’s additionally altering how knowledge groups work, with 70% of execs now utilizing AI to help with code growth, and 40% reporting that their knowledge groups are rising. Whereas funding in AI instruments is main the way in which, knowledge high quality stays a persistent problem, with over 56% of practitioners highlighting it as a key concern.
These insights come from dbt Labs’ 2025 State of Analytics Engineering Report, the third version of their annual publication, which dives into how AI is redefining knowledge groups, the place budgets are being prioritized, and why constructing belief in knowledge is extra essential than ever.
A key discovering of the report is that AI is augmenting, not changing knowledge groups, as many had anticipated it to. As a substitute of changing human experience, AI adoption is altering how folks work. It’s permitting professionals to spend much less time on redundant duties and focus extra on specialised work. The report highlights that greater than two-thirds (70%) of respondents use AI for analytics growth in some type.
The rising investments in AI instruments to help knowledge groups foster a extra constructive notion of their contributions. Because of this, 75% of respondents agree that their organizations extremely worth and belief their knowledge groups.
“AI is disrupting the way in which that groups work with organizational knowledge,” stated Mark Porter, CTO of dbt Labs. “As firms improve AI investments, leaders are prioritizing the groups chargeable for knowledge high quality and governance—the important basis for AI effectiveness.”
“On the similar time, knowledge engineers are turning to AI to automate routine duties, fully altering how knowledge is delivered to the enterprise. Due to this, the strategic function of the info workforce continues to develop, with AI because the catalyst. It’s a symbiotic relationship – knowledge professionals make AI higher, and AI makes knowledge groups higher.”
Analytics engineering is rising past tech, with extremely regulated industries like finance (15%) and healthcare (10%) adopting it to handle advanced, compliance-heavy knowledge. Tech stays the biggest sector at 34%, although its share has declined by 3% this 12 months.
Based on dbt Labs, organizations are investing in knowledge once more after a cautious interval. AI instruments are the highest precedence, with 45% planning to spend extra on them within the subsequent 12 months. Information high quality and observability come subsequent, with 38% specializing in fixing key knowledge challenges.
Supply: Shutterstock
AI instruments lead funding priorities, with 45% of respondents planning to spice up spending on this space over the following 12 months. Information high quality and observability comply with, with 38% aiming to extend funding to sort out pressing knowledge high quality challenges. A number of different reviews have highlighted the pressing want for organizations to sort out knowledge high quality points, and this was a recurring theme all through this 12 months’s dbt Labs report.
The highest use circumstances for AI embrace code growth (70%), adopted by documentation (50%), and answering knowledge questions with SQL era (22%). The report reveals that knowledge groups are counting on general-purpose LLMs equivalent to OpenAI’s ChatGPT and Gemini.
Nonetheless, as a result of these instruments aren’t tailor-made for particular analytics duties, organizations are more and more adopting specialised GenAI brokers. At the moment, 25% of respondents are utilizing AI options constructed into their growth tooling
The report’s findings additionally reveal that curiosity in semantic layers, instruments that make knowledge clearer and extra structured, can be rising, with 27% planning to take a position extra on this space. There’s additionally a better give attention to empowering nontechnical customers to work with remodeled, ruled datasets, which might enhance knowledge effectivity – a key focus for analytics engineering.
There’s a rising push to empower nontechnical customers. Practically 65% of respondents imagine that enabling enterprise stakeholders to create and work with remodeled and ruled datasets would considerably enhance organizational knowledge effectivity. Nonetheless, this highlights a core problem in analytics engineering: sustaining knowledge integrity whereas making certain broader accessibility.
dbt Labs CEO Tristan Useful
On the dbt Cloud Launch Showcase occasion in Could 2024, dbt Labs CEO Tristan Useful, highlighted the impression of AI for knowledge professionals. He stated, “And whereas this cloud transition remains to be enjoying out, AI goes to be the following large change in our lives as knowledge professionals. The adjustments we’ll see over the approaching years might be simply as dramatic as these we’ve seen play out over the previous decade.”
dbt Labs makes a speciality of analytics engineering and is well-positioned to supply insights into the evolving discipline. This 12 months’s report is predicated on a survey of 459 knowledge professionals, together with particular person contributors (70%) and managers (30%). Among the many particular person contributors, 48% had been analytics engineers, 36% had been knowledge engineers, and 16% had been knowledge analysts.
Later this month, dbt Labs will host the 2025 State of Analytics Engineering Digital Occasion. The occasion’s agenda will embrace discussions on the report’s key findings, together with broader methods for constructing efficient knowledge organizations, integrating GenAI, and addressing ongoing trade challenges.
