Microsoft Announces Maia AI Accelerator's Internals and SDK for Powering AI Workloads

Posted on Edited on

Quick Report

Microsoft has announced the internals of its Maia AI accelerator, which is designed to power AI workloads. The accelerator is huge tile die with size ~820mm made with TSMC N5 process with COWOS-S packaging, 700W TDP, 500MB L1/L2 cache, custom network accelerator with peak throughput of 1.2Tbps.

Maia AI chips comes with first class support for running PyTorch and Triton AI workloads backed with Maia SDK for accelerating AI workloads End to End with fully vertical integration on Azure.

Source(s)

  • MSFT Blog
  • TPU