Alluxio, the developer of open source cloud data orchestration software, is releasing version 2.5 of its Data Orchestration Platform featuring access via POSIX and S3 interfaces, enabling data platform teams to accelerate data pipelines for both business intelligence and model training.
“For modern AI/ML data pipelines, the preferred application programming interface (API) for storage access is not HDFS,” said Haoyuan Li, founder and CEO, Alluxio. “With this release, Alluxio significantly improves support for model training pipelines with an accelerated POSIX API for unified storage access, performance and ease of management.”
Alluxio 2.5 also improves compatibility with the S3 API. Together S3, HDFS and POSIX make up a majority of the APIs preferred by data driven applications and data management tools.
Administrators now have the flexibility to manage the Alluxio file system namespace through a standard object storage console. This flexibility makes it even simpler to integrate Alluxio into existing large scale data pipelines, according to the vendor.
New and updated storage connectors on Amazon Web Services, Azure Cloud, and Google Cloud Platform improve the onboarding experience with seamless authentication and improved performance.
Data lakes on all major cloud platforms can now easily integrate Alluxio to orchestrate data management. A new Quickstart guide using Data Orchestration Hub for single, hybrid or multi-cloud data orchestration is also included, along with support for the Hub on Kubernetes.
For more information about these updates, visit www.alluxio.io.