ODPi, a nonprofit organization providing big data solutions, has announced that several new solution and application providers have signed onto the ODPi Interoperable Compliance Program.
DataTorrent, IBM, Pivotal, SAS, Syncsort, WanDisco, and Xaivent will now work together across a wider range of commercial Apache Hadoop platforms.
ODPi programs are aimed at giving end users greater choice and flexibility by fostering an open big data ecosystem that transcends traditional vendor alliances.
To date, a dozen ODPi Interoperable applications have been tested to successfully run on multiple ODPi Runtime Compliant Platforms.
Currently, Altiscale, ArenaData, Hortonworks, IBM, and Infosys Apache Hadoop Platforms are ODPi Runtime Compliant, offering greater simplicity for big data solution and application providers.
Additionally, ODPi’s platform, the ODPi Runtime Specification 2.0, will add Apache Hive and Hadoop Compatible File System support (HCFS).
These components join Yarn, MapReduce and HDFS from ODPi Runtime Specification 1.0. By including Apache Hive, which read, write, and manage large datasets residing in distributed storage, ODPi will reduce SQL query inconsistencies across Hadoop Platforms.
ODPi will base its work on Hive version 1.2 and ensure there is core functionality that will continue to behave in a standard way for future versions of Apache Hive.
HCFS support will enable storage and cloud vendors to leverage ODPi standards, letting them leverage their native storage solutions as part of an ODPi Runtime Compliant Hadoop Platform and reduce the incompatibilities that end-users face.
“As our work continues to complement the Apache Software Foundation, ODPi is helping the Hadoop ecosystem become more valuable to those who are testing and building big data applications,” said John Mertic, director of ODPi. “Through a common specification, we are enabling developers to easily write applications that sit on top of big data stacks, lowering the costs of interoperability across systems. For enterprises, the benefits are increased efficiency, flexibility and smoother maintenance.”
For more information about this news, visit opdi.org.