(Shutterstock/Peeradontax and Viktoriia Debopre)
Snowflake and Databricks have emerged as the 2 information warehousing behemoths of the cloud period, trudging away at one another to draw clients and their large information workloads. Maybe it’s not a coincidence, then, that the 2 distributors will holding their respective annual conferences in the identical San Francisco location, separated by per week, in early June.
Snowflake kicks issues off first with its Snowflake Summit 25, which is scheduled to happen on the Moscone Heart June 2-5. Referred to as the Information Cloud Summit in earlier years, the Snowflake Summit this 12 months will attempt to exceed the attendance of final 12 months’s present, which introduced between 15,000 and 16,000 attendees to the downtown San Francisco location.
The main focus for Summit 2025 will probably be constructing and working large information, superior analytics, and AI programs on Snowflake’s information platform. Attendees who pay the final admission payment of $2,295 may have their choose of greater than 500 periods over 15 tracks, with greater than 190 distributors within the expo. The opening keynote, which will probably be livestreamed beginning at 5 p.m. PT Monday, June 2, will function Snowflake CEO Sridhar Ramaswamy together with Lynn Martin, President of the New York Inventory Alternate Group, and Sam Altman, the CEO and co-founder of OpenAI.
Databricks follows up with its personal convention, the Information + AI Summit, which takes place at Moscone Heart June 9-12. The corporate touted 16,000 attendees at its 2024 occasion, plus one other 40,000 attending just about, and this 12 months, the corporate is estimating that 20,000 folks will attend in individual.
(monticello/Shutterstock)
Information + AI Summit attendees who purchase a full ticket for $1,895 may have their choose of greater than 700 periods, which can concentrate on utilizing the Databricks platform to construct–you guessed it–large information, superior analytics, and AI functions. JPMorgan Chase CEO and Chairman Jamie Dimon and Dario Amodei, the co-founder and CEO of Anthropic, will be a part of Databricks Co-Founder and CEO Ali Ghodsi on the stage through the Wednesday morning keynote, which will probably be livestreamed beginning at 8 a.m. PT.
There was a ton of reports popping out of final 12 months’s Snowflake and Databricks conferences, a lot of it centering across the emergence of Apache Iceberg because the defacto trade normal for giant information desk codecs.
Snowflake, which had beforehand supported Iceberg, rolled out its open supply Polaris metadata catalog, which served because the REST-based glue that enabled Snowflake clients to attach Iceberg tables to quite a lot of compute engines, together with Snowflake’s proprietary engine but in addition Trino, Dremio, Apache Spark, Apache Flink, and Apache Doris, amongst others. Polaris is now incubating on the Apache Software program Basis, and seems on target to changing into one other normal for the category of expertise referred to as metadata catalogs (to not be confused with normal information catalogs).
To not be outdone, Databricks introduced the acquisition of Tabular, the business Iceberg outfit based by the creators of the Apache Iceberg challenge, throughout Snowflake’s 2024 convention. In welcoming the Iceberg group, Databricks unveiled a roadmap that referred to as for Apache Iceberg and its personal Delta Desk to finally merge, thereby eliminating the danger that clients would select the “unsuitable” desk format.
(bluestork/Shutterstock)
The 2 occasions shook the large information group in ways in which haven’t been seen because the collapse of Hadoop half-a-decade earlier. Massive organizations that had held off constructing next-generation large information lakes primarily based on one of many open desk codecs instantly had a inexperienced gentle from the largest distributors that Iceberg was the winner. It was a large win for open platforms and for organizations who feared that information platforms would maintain their information hostage.
What’s going to the dueling Snowflake and Databricks occasions deliver this 12 months? It’s unlikely we’ll expertise such a monumental as we did final 12 months, with the emergence of Iceberg and Polaris as trade requirements. The group continues to be checking out the significance of desk codecs and metadata catalogs, so you possibly can count on to see fairly a little bit of content material round these matters.
The massive information this 12 months is prone to revolve round what all people appears to be speaking about: Agentic AI. Know-how distributors are quickly rolling out methods to construct and coordinate giant numbers of AI brokers to deal with all kinds of duties, starting from customer support to writing and deploying code. It’s a superb wager that agentic AI would be the primary matter at each Snowflake and Databricks occasions this 12 months, though there at all times are surprises.
What are your ideas on the 2 conferences? On the Databricks versus Snowflake battle? As at all times, you possibly can tell us what you’re pondering by dropping us a line at [email protected].
Associated Gadgets:
It’s Go Time for Open Information Lakehouses
Snowflake Embraces Open Information with Polaris Catalog
Databricks Nabs Iceberg-Maker Tabular to Spawn Desk Uniformity
