We’re excited to announce the Public Preview of the Microsoft Energy BI process kind in Databricks Workflows, accessible on Azure, AWS, and GCP.
With this new process kind, customers can now replace and refresh Energy BI semantic fashions straight from Databricks. This results in higher complete value of possession, larger effectivity, and ensures information is up-to-date for Energy BI report and dashboard customers.
Key advantages embody:
- Direct integration: Publish datasets from Unity Catalog to Energy BI straight from information pipelines.
- Replace Energy BI when your information updates: Considerably cut back refresh prices by updating semantic fashions solely when information modifications.
- Knowledge freshness for BI: Ship contemporary insights by robotically pushing modifications to underlying tables and their relationships.
Automate information integration from Unity Catalog with Energy BI
With the Energy BI process, now you can automate Energy BI semantic mannequin updates and refreshes straight from Databricks Workflows. This eliminates the necessity to change contexts between Databricks and Energy BI, streamlining the method of creating your information accessible for visualization and evaluation in Energy BI.
Energy BI duties absolutely assist Unity Catalog information objects together with tables, views, materialized views, and streaming tables. One of the best half – you possibly can construct Energy BI semantic fashions based mostly on Unity Catalog information objects from a number of schemas and catalogs.
Native integration amongst Unity Catalog, Energy BI, and Microsoft Entra ID means best-in-class safety, governance, and observability. Energy BI semantic fashions will be configured to make the most of OAuth with Single Signal-On to make sure that permissions are honored for every dashboard question together with the total suite of governance and observability capabilities that Unity Catalog gives. This integration enhances safety and compliance by offering seamless authentication, authorization, and information entry management throughout your Databricks and Energy BI environments.
All the energy of Databricks Workflows and Energy BI
Energy BI duties are constructed into Databricks Workflows so you possibly can leverage its superior orchestration and monitoring capabilities. This implies you possibly can lengthen highly effective options resembling process dependencies, schedules/triggers, retries, and notifications to information pipelines that make the most of Energy BI duties.
Energy BI duties assist publishing, updating, and refreshing semantic fashions in Import, Direct Question, and Twin Storage modes, offering you with full flexibility to steadiness efficiency and safety.
Extensibility is entrance and middle with Energy BI duties. You’ll be able to work with Energy BI duties visually within the Databricks Jobs UI in addition to programmatically through the Jobs API and Databricks Asset Bundles.
The way it works
State of affairs: You’ve got an current retail analytics information pipeline that ingests information from supply databases utilizing a pipeline process and applies transformations and aggregations utilizing a pocket book process, leading to a group of BI-ready tables. You’ve acquired a request to make sure a Energy BI semantic mannequin is in sync with this information because it modifications over time.
Making a Energy BI process is straightforward. All you’ll want to do is:
- Navigate to your current job
- Add a Energy BI process to the present job and select a SQL warehouse
- Choose a Energy BI connection, workspace, and semantic mannequin
- Choose Import or DirectQuery mode
- Choose Unity Catalog information objects
- Set an authentication technique
- Save the duty
Now the following time your current information pipeline runs, your Energy BI semantic mannequin will robotically replace as your information modifications.
Inside seconds of your job efficiently finishing, your dataset will likely be up to date in Energy BI, prepared for report creation and evaluation.
Getting Began with Energy BI duties
With Energy BI duties now in Public Preview, you possibly can empower information engineers to supercharge their information pipelines and seamlessly combine their business-friendly datasets with Energy BI.
We’re excited to see how you’ll use Energy BI duties and encourage you to provide them a attempt as we speak. To get began, please go to the Energy BI process documentation.
Seeking to deepen your Energy BI + Azure Databricks integration?
Try Half 1 and Half 2 of our connectivity collection:
Collectively, these blogs present important greatest practices to optimize safety and efficiency when connecting Energy BI to Azure Databricks.
The Databricks group is at all times trying to enhance the Energy BI integration expertise, and would like to hear your suggestions!
