Spurred by demands in generative artificial intelligence, supercomputing and advanced analytics, data management is evolving rapidly. In tune with that evolution, Cloudera Inc. is partnering with Snowflake Inc., with several data flexibility integrations and enhancements slated to reach enterprise users.
Cloudera’s David Dichmann talks with theCUBE about its partnership with Snowflake.
“The partnership with Snowflake focuses on this thing called the Iceberg REST Catalog, which is basically the ‘easy button’ for different data engines and data compute environments to … talk to any data anywhere so that we can share this data more uniformly,” said David Dichmann (pictured), senior director of product management at Cloudera. “The key ingredient is this Apache Iceberg table format. It’s released data from the confines of proprietary formats. That data is now more freely accessible provided you know how to use it and how you can find the start of the data, get the permissions to the data [and] all those sorts of things.”
Dichmann spoke with theCUBE Research’s Bob Laliberte and co-host Rebecca Knight at the Cloudera Evolve24 event during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed the collaboration’s focus on maximizing the value of business data by offering improved data flexibility, accessibility and security in a seamless, integrated environment. (* Disclosure below.)
Unlocking data flexibility with Iceberg
At the heart of the Cloudera and Snowflake partnership lies Apache Iceberg, an open table format designed to handle large datasets efficiently. Iceberg liberates data from proprietary constraints, making it easily accessible for various use cases, according to Dichmann. The integration offers significant advantages for businesses. It allows organizations to combine structured and unstructured data into a unified open data lakehouse, eliminating the complexity of moving data across systems.
“The open data lake house allows us to put all of the different types of data together in one place — structured, unstructured, curated [and] raw — and then use it for all of the different use cases as needed,” he said.
Customers leveraging this integration have seen reductions in maintenance burdens and more efficient use of resources. The unified approach also enables businesses to run multiple use cases — such as analytics, AI training and reporting — on a single dataset, extracting more value from their data, Dichmann noted.
Here’s the complete video interview, part of SiliconANGLE’s and theCUBE Research’s coverage of the Cloudera Evolve24 event:
(* Disclosure: TheCUBE is a paid media partner for the Cloudera Evolve24 event. Neither Cloudera Inc., the sponsor of theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)