d-Matrix, a provider of high-efficiency AI-compute and inference, is partnering with Microsoft to use its low-code reinforcement learning (RL) platform, Project Bonsai, enabling an AI-trained compiler for d-Matrix’s digital in memory compute (DIMC) products.
The user-friendly Project Bonsai platform accelerates time to value, with a product-ready solution that cuts down on development efforts using an AI-based compiler that leverages ultra-efficient DIMC technology from d-Matrix, according to the vendor.
Combining d-Matrix technology with Project Bonsai enables the efficient creation of a compiler for the DIMC platform. Project Bonsai accelerates rapid prototyping, testing, and deploying of trained RL agents in the compiler stack to take full advantage of low power, AI inference technology from d-Matrix that can deliver up to ten times the power efficiency of older architectures.
“d-Matrix has built the world’s most efficient computing platform for AI inference at scale,” said Sudeep Bhoja, Co-Founder, CTO at d-Matrix. “What made us gravitate towards Project Bonsai is its product-first features and ease of use. Microsoft’s unique offering is built around machine teaching and the Inkling language, which makes RL constructs fully explainable.”
d-Matrix transforms the economics of complex transformers and Generative AI with a scalable platform built to handle the immense data and power requirements of inference AI, making energy-hungry data centers more efficient, according to the company.
This novel AI compute platform from d-Matrix uses an ingenious combination of intelligent ML tools and integrated software architectures utilizing chiplets in a Lego block grid formation, which enables the integration of multiple programming engines in a common package.
The RL based compiler is expected to become a key differentiator of d-Matrix’s first generation DIMC product offering, CORSAIR, on track to ship in late 2023.
“We have been working together developing the RL based compiler,” said Kingsuk Maitra, principal applied AI engineer at Microsoft, with the Project Bonsai team. “We made it a point to have a product mindset from the get-go. Embodiments including the instruction set architecture have been vetted and validated on two d-Matrix test chips, NightHawk and JayHawk, and embedded into the RL training environment. Project Bonsai’s low code attributes made early development work easy, and the ability to integrate statistical control parameters and make integration of other real life chip design constraints simpler, with very promising results so far.”
For more information about this news, visit www.d-matrix.ai.