We’re excited to announce the Public Preview of the Azure Databricks connector in Energy Platform. The brand new connector is a game-changer for organizations trying to seamlessly combine Azure Databricks with Microsoft’s low-code ecosystem-including Energy Apps, Energy Automate, and Copilot Studio. This connector bridges the hole between superior analytics and enterprise course of automation, enabling safe, ruled, and real-time information entry – with out the complications of customized connectors or information duplication. That is all made potential by the foundations of the Databricks SQL information warehouse, a product purpose-built for analytics, and Azure Databricks, a primary get together service absolutely built-in inside the Azure and Microsoft ecosystem.
The Problem Earlier than: Workarounds, Information Silos, and Governance Gaps
Earlier than this connector, connecting Energy Platform purposes to Azure Databricks was irritating. Groups needed to depend on customized connectors, REST APIs, or oblique information exchanges via storage accounts and orchestrated pipelines. These workarounds usually led to information duplication, required guide upkeep, and weren’t in a position to leverage governance offered by Unity Catalog. Consequently, this slowed groups’ means to innovate.
What’s Now Attainable: Actual-Time, Safe Information for Each Energy Platform App
The brand new Azure Databricks connector solves all of those challenges.
- No Information Duplication: All interactions occur in actual time, immediately towards Azure Databricks tables-eliminating the necessity for information exports, guaranteeing a single supply of fact.
- Authentication: The connector leverages Microsoft Entra ID (previously Azure AD) for safe authentication, supporting each user-based OAuth and repair principals.
- Governance: Depend on Unity Catalog’s fine-grained entry controls immediately inside Energy Platform apps-no twin safety fashions or guide coverage syncs required. Auditing capabilities can be found via Question Historical past.
- Simple Setup and restricted upkeep: From Energy Apps, Energy Automate, or Copilot Studio, merely choose the Databricks connector, authenticate, and begin constructing. No customized API plumbing or upkeep required.
This allows organizations to construct data-driven experiences that leverage the total energy of their information inside Azure Databricks. Let’s have a look:
I. Energy Apps: Construct low-code canvas apps that may learn and write (create, replace, and delete) information in real-time.
II. Energy Automate: Create workflows that execute SQL instructions towards your information in Azure Databricks information
III. Copilot Studio: Construct customized brokers with Azure Databricks because the information supply
Fixing Actual-World Use Circumstances: Sooner Innovation, Maintained Governance, and No Information Duplication
Now, Azure Databricks clients who leverage the Energy Platform connector can expertise a simplified means to construct Energy Platform purposes with their information in Azure Databricks.
Remodeling Warehouse Security: Coty’s Energy Platform Success Story
Take Coty, who’s a worldwide magnificence powerhouse recognized for its iconic manufacturers and daring innovation. They leverage Energy Platform to construct business-critical Energy Apps and automation workflows.
An excellent instance is their software to trace warehouse security incidents, developed by considered one of their Digital Answer Builders, Victor-Hugo Fantasia, which performs an important function in maintaining warehouse workers secure. Earlier than Energy Platform, warehouse groups used to depend on guide reconciliation throughout paper kinds and siloed Excel information to log security occasions. This led to frustration, delays and misplaced information.
Now with Energy Platform, workers can report security incidents in seconds. If any high-risk incidents are reported, automation workflows instantly set off notifications to security leads. All submissions feed real-time dashboards and supply managers a 360-degree view into security efficiency.
This easy resolution has pushed compliance charges up dramatically, minimize information reconciliation time, and enabled day by day security critiques, empowering groups to deal with hazards sooner and enhance web site security throughout the board.
“I by no means thought connecting to our information lake could possibly be as straightforward as connecting to a SharePoint checklist. With the Azure Databricks connector in Energy Apps, our workforce can now spin up customized apps to seize and approve planning information, monitor security incidents in actual time, streamline transportation buyer claims, and feed actual‑time dashboards utilizing minimal code, with nearly no studying curve. This streamlined method will considerably scale back implementation time and allow us to concentrate on fixing enterprise issues sooner!”
— Michael Gibson, Provide Chain Digital Options Supervisor, Coty
Empowering Groups with Know-how: UK Energy Networks’ Wider Name Dealing with App
Or take UK Energy Networks, a number one electrical energy distributor recognized for its dependable service and dedication to powering hundreds of thousands of houses and companies throughout the UK. In an business the place fast response and clear communication are essential, UK Energy Networks has embraced know-how to help its groups and ship higher outcomes for patrons.
A primary instance is their Energy App developed particularly for Wider Name Dealing with (WCH), which is a system designed to help name handlers throughout excessive demand intervals attributable to antagonistic climate. The WCH Energy App transforms how UKPN helps affected clients. As an alternative of counting on guide processes, the app gives an enhanced, streamlined method to proactively handle communication and help with these impacted by outages or disruptions. Name handlers can simply replace clients, coordinate responses, and guarantee well timed data and help, all from a central, user-friendly platform.
“Integrating the Databricks connector inside the Energy Platform has been game-changing for us at UKPN. It permits us to harness Azure Databricks’ superior efficiency and massive information capabilities alongside the agility of low-code options, delivering vital worth throughout the enterprise.
This integration has additionally helped us keep momentum in our Digitisation technique, enabling us to seamlessly re-point present Energy Platform deliverables from legacy back-ends to cutting-edge applied sciences.”
— Karime Slimani, Lead Information Engineer, UK Energy Networks
How It Works: Safe, Ruled Connectivity-No Customized Code Required
Establishing the Azure Databricks Energy Platform connector is designed to be easy and safe:
- Open Energy Apps or Energy Automate
- Go to the ‘Connections’ web page inside this software
- Click on ‘+New Connection’ and seek for Azure Databricks
- Authenticate to Azure Databricks utilizing OAuth or a Microsoft Entra Service Principal
- Begin constructing – canvas energy apps, automation workflows, and copilot studio brokers with Databricks as a information supply
Strive It Out: Get began with Azure Databricks Energy Platform Connector
The Energy Platform Connector is now out there as Public Preview for all Azure Databricks clients. Discover extra within the deep dive weblog right here and to get began, try our technical documentation.