IBM and Hortonworks are expanding their partnership focused on extending data science and machine learning to more developers and across the Apache Hadoop ecosystem.
The companies are combining the Hortonworks Data Platform (HDP) with the IBM Data Science Experience and IBM Big SQL into new integrated solutions designed to help users better analyze and manage data for better decision making.
“The combination of IBM’s data science and Hortonworks’ open and connected data platforms will benefit not only our respective clients, but also the Apache open source community because of our combined investment and collaboration,” said Rob Bearden, CEO, Hortonworks. “We’re excited about the inevitable acceleration in technical innovations that this relationship is being designed to foster, the result being smarter and more agile businesses.”
This partnership will provide an integrated and open data science and machine learning platform to enable teams to collaborate and operationalize data science, said Rob Thomas, general manager, IBM Analytics. By using advanced machine learning and deep learning capabilities, the combination of Hortonworks Data Platform with IBM's Data Science Experience and the IBM Machine Learning platform can help clients achieve improved analytic results faster and at scale.
Building on the companies’ previously established partnership, Hortonworks will resell the IBM Data Science Experience with HDP, a Hadoop distribution, and adopt it as its strategic data science platform, giving developers a fast on-ramp to data science capabilities including machine learning, advanced analytics and statistics. Also, Hortonworks and IBM will create new solution bundles that integrate HDP with IBM Big SQL, IBM’s SQL engine for Hadoop, giving Hortonworks’ clients and users a familiar method of managing their data.
IBM is adopting HDP for its Hadoop distribution and will integrate it with its Data Science Experience and Machine Learning, creating a solution that combines the data security, governance and operations functionality provided by HDP, and the analytics and management of the Data Science Experience. IBM will migrate existing IBM BigInsights users to HDP.
IBM Data Science Experience provides a set of tools and a collaborative environment through which analysts and developers can create new analytic models. For example, IBM Machine Learning, found in the Data Science Experience, can speed the time it takes to build and deploy analytic models for application development by two-times, according to IBM testing.
In addition to the companies’ product collaborations, IBM and Hortonworks are also founding members of the Open Data Platform Initiative (ODPi). Launched in February 2015, ODPi is comprised of industry leaders working collaboratively to define and promote a set of standard open source technologies and increase compatibility among big data platforms.
As part of their ]partnership, the companies will also join forces to advance the development of Unified Governance (IBM BigIntegrate, IBM BigQuality and IBM Information Governance Catalog) on the Apache Atlas open platform. Atlas provides a scalable governance platform for Enterprise Hadoop which is designed to help developers model new business processes and data assets quickly and easily. Through their work, both companies plan to help advance Atlas from its current Incubator status to Apache Top Level Project status, where projects are typically released for open development and deployment.
In addition to Atlas, the companies will also partner on the advancement of Apache Spark, the open source framework for processing and analyzing large datasets across clustered environments. The companies will also collaborate to advance the Apache Hadoop framework itself, working to unify access to multi-vendor, heterogeneous data environments across data warehouses and databases.
For more information, go to www.hortonworks.com and www.ibm.com/analytics.