We’re excited to announce the Basic Availability of Lakeflow Join for Salesforce and Workday. Lakeflow Join introduces no-code ingestion connectors for standard SaaS purposes, databases, and file sources—enabling you to construct scalable ingestion pipelines and unlock the total energy of your knowledge with the Databricks Knowledge Intelligence Platform. The Salesforce and Workday connectors are the primary managed connectors to be launched to GA because the Lakeflow Join announcement final July, with many extra on the way in which.
Lakeflow Join’s managed knowledge connectors are powered by serverless compute and can be found throughout AWS, Azure and GCP. They’re totally built-in with the Knowledge Intelligence Platform for governance, observability and enterprise safety.
Lakeflow Join is the primary of three elements launched as a part of Lakeflow, the unified engineering resolution for ingestion, transformation and orchestration. It really works seamlessly with DLT for transformation and Databricks Workflows for orchestration.
Early adopters like Porsche Holding, Insulet, Equiniti, Stroër SE & Co. and Flick are already utilizing Lakeflow Join to resolve a few of their hardest knowledge challenges.
Knowledge silos trigger ingestion complexity, inefficiency
Right this moment, it’s tough to construct and keep ingestion pipelines for SaaS purposes your self as a result of every API is exclusive and adjustments typically. In the meantime, database ingestion will be much more advanced, typically requiring additional infrastructure comparable to digital machines for extraction instruments, Kafka for streaming, and a powerful understanding of change knowledge seize (CDC) applied sciences for environment friendly ingestion.
In consequence, organizations spend a number of time constructing, optimizing, and sustaining a patchwork of pipelines. This slows down tasks and might create a fragmented ETL structure that’s tough to control. It additionally forces extremely expert knowledge engineers to spend time transferring knowledge and monitoring pipelines as a substitute of creating strategic improvements.
Constructed-in knowledge ingestion assist for Salesforce and Workday
Lakeflow Join eliminates these challenges by making it straightforward to create production-ready pipelines with just a few clicks within the UI or just a few traces of code. Beneath the hood, ingestion is environment friendly, with incremental updates and optimized API utilization. As your managed pipelines run, we maintain schema evolution, seamless third-party API upgrades, and complete observability with built-in alerts.
“With the Salesforce connector, we efficiently decommissioned 4 providers, which considerably streamlined our tech stack and lowered our prices. This integration not solely simplified our structure but additionally improved our operational effectivity, permitting us to concentrate on delivering extra worth with fewer sources.”
— Simon Salmeri, Head of Knowledge Platform, Ströer
Lakeflow Join for Salesforce means that you can pair Databricks’ superior analytics and AI instruments with Salesforce’s CRM knowledge to construct a more practical vendor expertise: predicting gross sales developments, deepening insights into buyer behaviors, and personalizing engagement methods. The connector helps Salesforce-specific necessities, like customized objects and components fields.
“We’ve been utilizing the Lakeflow Join Salesforce connector for a advertising segmentation use case. Our Salesforce knowledge holds essential details about our prospects, and the connector has been the lacking piece to carry this dataset into our lakehouse.… We at the moment are at only the start of understanding our prospects higher and bettering their expertise.”
— Ana-Maria Mocanu, Knowledge and Insights Lead, Flick
Databricks and Salesforce introduced a strategic partnership in 2023 to construct sturdy integrations for our joint prospects. Since then, we launched the zero-copy Salesforce Knowledge Cloud Connector so prospects can uncover, question, and govern Salesforce Knowledge Cloud straight from Unity Catalog. Paired with Lakeflow Join for Salesforce, prospects can use each their CRM knowledge and their CDP knowledge inside Databricks.
Lakeflow Join for Workday additionally supplies easy, low-maintenance ingestion. You possibly can entry customized Workday stories for centralized analytics in your worker workforce.
Each connectors seamlessly combine with the Knowledge Intelligence Platform, so you should use:
- DLT to remodel knowledge declaratively and replace transformations incrementally as knowledge continues to stream in
- Databricks Workflows to orchestrate these pipelines
- Databricks Asset Bundles (DABs) to handle steady integration and supply
- Superior analytics and machine studying instruments to drive enterprise worth
- Unity Catalog to control your knowledge and pipelines
- Lakehouse Monitoring to keep up the standard of your knowledge
Driving high-value enterprise use instances
Lakeflow Join helps unlock high-value use instances throughout numerous industries, comparable to understanding buyer habits, analyzing HR knowledge, or figuring out upsell alternatives.
A standard use case is predicting buyer churn. Within the video beneath, we exhibit how a retailer can do that by ingesting Salesforce buyer order knowledge and mixing it with buyer interactions throughout different channels for enriched insights.
Demo: use Lakeflow Join for Salesforce to foretell buyer churn.
One other use case is making a buyer assist dashboard for executives and assist groups. You possibly can even use LLMs to diagnose the developments that seem within the dashboard, as proven in this step-by-step weblog put up.
For human sources departments, the Workday connector can assist observe and predict HR developments, comparable to worker turnover. For instance, you may ingest related Workday stories, remodel them with DLT, and incorporate the outcomes into an AI/BI dashboard.
Lots of of consumers utilizing Lakeflow Join
Clients are already ingesting knowledge from a wide range of sources with Lakeflow Join.
As one of many world’s most profitable automotive firms, Porsche Holding Salzburg (Porsche) is Europe’s largest automotive retail firm with operations in 23 international locations. Porsche needed to deal with their knowledge integration challenges and streamline entry to their buyer knowledge in Salesforce Gross sales Cloud. Utilizing Lakeflow Join, Porsche was capable of ingest knowledge from Salesforce, remodel it in batch and streaming modes, and deploy and function the pipelines in manufacturing. Right this moment, the Databricks Knowledge Intelligence Platform types the core of the Porsche group’s Knowledge Platform. Be taught extra about Porsche’s success utilizing Lakeflow Join.
“Utilizing the Salesforce connector from Lakeflow Join helps us shut a important hole for Porsche from the enterprise facet on ease of use and worth. On the shopper facet, we’re capable of create a very new buyer expertise that strengthens the bond between Porsche and the shopper with a unified and never fragmented buyer journey.”
— Lucas Salzburger, Undertaking Supervisor, Porsche Holding
Insulet is a medical machine firm that developed the Omnipod product platform, and so they had been an early adopter of Lakeflow Join. With a mission to simplify life for folks with diabetes and different circumstances, they sought to faucet into their CRM insights to raised perceive their buyer wants. They used the Salesforce connector to scale back their ETL latency from days to minutes—bettering the decision course of for his or her prospects with close to real-time insights.
“The LakeFlow Join’s Salesforce connector was particularly essential because it allowed us to straight ingest buyer suggestions, gross sales knowledge and repair interactions from the Salesforce CRM into Databricks. LakeFlow Join utterly modified how we deal with Salesforce knowledge. We removed unreliable middleware and might now analyze every part straight in Databricks – sooner and with much less handbook effort.”
— Invoice Whiteley, Senior Director of AI, Analytics and Superior Algorithms, Insulet
Equiniti (EQ) is a world chief in shareholder, pension, and remediation providers, and so they needed to centralize knowledge and insights into their operations. Utilizing Lakeflow Join for Salesforce, Workday, and SQL Server, EQ seamlessly solved for ingestion—thus releasing up important engineering expertise to concentrate on utilizing Mosaic AI to boost the shopper expertise for his or her 6,000 firms throughout 136 international locations. For EQ, the power to seamlessly create no-code integrations to their core platforms helped them save time and extra prices, letting them concentrate on worth multipliers like Gen AI purposes. Learn the way EQ constructed a safe and unified knowledge and AI platform in three steps.
Getting began with Lakeflow Join
Knowledge groups can now use Lakeflow Connect with construct environment friendly, incremental pipelines at scale, with just some clicks or traces of code. Get began as we speak with the Salesforce or Workday connector to assist unlock high-value use instances, comparable to predicting buyer churn, working customized buyer analytics, and figuring out upsell alternatives.
Lakeflow Join’s roadmap contains further connectors like SQL Server, Google Analytics, ServiceNow, SFTP, SharePoint, and PostgreSQL. Keep tuned for extra bulletins this yr, or attain out to your Databricks account group should you’re thinking about becoming a member of a preview for early entry.
Lakeflow Join has a compute-based pricing mannequin. Salesforce and Workday, which run completely on serverless infrastructure will incur serverless DLT DBT costs. See extra particulars on charges.
To get began with Lakeflow Join for Salesforce and Workday, you may assessment the documentation or strive this resolution accelerator.
