TSTickerStarGet alerts

Microsoft details Azure Maia 300 AI accelerator architecture; third-generation design delivers up to 7x rack-scale token throughput vs Maia 200

Microsoft published a technical deep dive on its third-generation Azure Maia 300 AI accelerator, describing the system-on-chip, rack-scale, and superpod design intended for cloud-scale agentic inference. Relative to Maia 200, Microsoft states Maia 300 delivers up to 7x greater rack-scale token throughput in a 96-accelerator configuration and more than 2.5x the performance per watt. The article does not disclose revenue, profit, or other financial results and does not provide financial guidance.

Share this story

Key takeaways

  • Maia 300 is Microsoft's third-generation Azure AI accelerator, optimized for long-context, reasoning-intensive, and decode-heavy LLM inference.

  • Compute dies are fabricated on TSMC N2P; memory/I/O functions are placed on separate chiplets, with a NUMA-style organization across chiplets.

  • Each accelerator includes 8 HBM4 stacks providing 288 GB of capacity and 18 TB/s of bandwidth.

  • System compute FLOPs are stated to rise 36%, HBM bandwidth 2.5x, and scale-up bandwidth 14% versus Maia 200.

  • Rack scale is 96 accelerators across 24 four-accelerator trays within a 167-kW rack, doubling accelerator density versus Maia 200.

  • A two-tier Ethernet-based scale-up fabric supports superpods of up to 12,288 accelerators with a single communication model.

  • Compared with Maia 200, Microsoft states Maia 300 delivers up to 7x rack-scale token throughput and more than 2.5x performance per watt.

Key metrics

Accelerator count per rackMaia 300 rack
96doubled vs Maia 200
Rack power envelopeMaia 300 rack
167 kW
HBM4 capacity per acceleratorMaia 300 accelerator
288 GB33% more capacity vs Maia 200
HBM4 bandwidth per acceleratorMaia 300 accelerator
18 TB/s2.5x memory bandwidth vs Maia 200
Compute FLOPs increase vs Maia 200Maia 300 vs Maia 200
36%+36%
Scale-up bandwidth increase vs Maia 200Maia 300 vs Maia 200
14%+14%
Rack-scale token throughput vs Maia 200Maia 300 vs Maia 200 (96-accelerator configuration)
up to 7xup to +600%
Performance per watt vs Maia 200Maia 300 vs Maia 200
more than 2.5xmore than +150%

Primary source

TickerStar generated this brief from an official company, investor-relations, earnings-call, or regulatory source. Review the primary material before making an investment decision.

Open Investor relations

Follow MSFT in real time

Get material earnings, filing, IR, and earnings-call alerts by email.

Create a free alert