Alluxio, a developer of open source cloud data orchestration software, has introduced a go-to-market solution in collaboration with Intel to offer an in-memory acceleration layer with 3rd Gen Intel Xeon Scalable processors and Intel Optane persistent memory (PMem) 200 series.
The solution enables high performance analytics and AI pipelines at a massive scale while minimizing the TCO by more seamlessly managing data in local storage tiers close to compute. Intel Optane PMem provides a cost-effective storage tier for Alluxio managed data, while accelerating performance with a disaggregated compute and storage architecture.
“With an explosion in the amount of data being managed by the Alluxio Data Orchestration system, effective memory and storage media provided by Intel has a huge value-add,” said Haoyuan Li, founder and CEO, Alluxio.
Intel 3rd gen Xeon Scalable processors with Intel Optane persistent memory 200 series delivers up to 6TB total memory per socket and on average 32% higher memory bandwidth than the previous generation. Using Storage over App Direct, a feature of PMem App Direct mode, allows Alluxio to access a high-performance block storage tier to provide the data access acceleration.
The solution builds on Alluxio’s strategic collaboration with Intel aimed at improving their customers’ experience with managing and processing their data, such as optimizations for Intel Deep Learning Boost and the AI acceleration technology built into the latest Intel Xeon Scalable processors. With its latest release, Alluxio now improves POSIX API support to further accelerate machine learning and AI workloads in addition to new storage connectors for cloud object storage.
For more information, go to www.alluxio.io.