Pivotal and EMC have introduced a new Data Lake Hadoop solution that combines massively scalable enterprise storage arrays with big data and analytics capabilities. According to the vendors, the new solution gives enterprises all the benefits of HDFS through an advanced turnkey Hadoop solution for critical production workloads. The Data Lake Hadoop solution combines EMC Isilon's scale-out storage, with Pivotal HD (Hadoop Distribution) and Pivotal HAWQ, a massively parallel processing SQL compliant query engine. Pivotal and EMC have worked together to test, benchmark and size the Data Lake Hadoop solution
According to the vendors, data lakes are increasingly emerging around HDFS-based clusters to handle complex workloads and unstructured data. The companies say that at this time, 67% of all capacity shipped is unstructured data, and by 2017, with the Internet of Things and the proliferation of devices, 80% of all capacity shipped will be unstructured data. To help organizations address this flood of unstructured data, the Pivotal/EMC Isilon Data Lake Hadoop solution leverages Apache Hadoop technology, providing enterprises with the tools necessary to build a modern data lake infrastructure.
"The combination of Pivotal HD and HAWQ analytics, with Isilon X410 offers HDFS solutions that satisfy all the requirements of today's enterprises: unrivaled storage scale and efficiency and the cost benefits through easy and fast deployments," said Sam Grocott, vice president of product management and marketing, Isilon Storage Division, EMC. "Customers get the most enterprise-grade, and easy to use Hadoop big data package, all with 24 x 7 global support and services."
The new Data Lake Hadoop bundle is available today and consists of pre-configured EMC Isilon X410 nodes, HAWQ subscriptions and Pivotal HD, Pivotal's enterprise version of Apache Hadoop. Pivotal HAWQ is the most advanced SQL standard compliance query engine for Hadoop in the market, and its massively parallel processing (MPP) is built on a decade of innovation from analytical data warehouse technologies.
More perspective is available in a Pivotal blog: Pivotal and EMC Come Together To Shore Up The Data Lake.