Microsoft plans multi-gigawatt rollout of next-gen Azure Maia AI accelerator racks

Microsoft has lifted the lid on the next generation of its Azure Maia custom AI chips, saying it will usher in a new phase of its compute infrastructure where everything is closely integrated to meet the demands of agentic inference. The Redmond giant says its Azure Maia 200, announced earlier this year, is now serving production workloads and that a successor is already planned for 2027. Azure Maia 300 is described as "a complete intelligent system" designed for the new types of AI workloads emerging today. Microsoft claims a full 96-accelerator configuration will deliver up to seven times Maia 200's rack-scale token throughput, while offering 40 percent more tokens per megawatt than leading GPU-based systems. Its next-gen chip is created with an inference-first architecture optimized for long-context, memory-intensive and decode-heavy AI workloads, according to a blog post by Microsoft's EVP for Cloud and AI, Scott Guthrie. …