← Back to stories
AI

Power and cooling limits force AI clusters with 100,000+ accelerators to use multiple data centers

The rapid growth of AI clusters is pushing computing infrastructure beyond the physical and power limitations of individual data centers, which creates demand for new networking architectures capable of connecting compute resources across multiple facilities and even geographical regions. At Supercomputing 2026 (SC26), researchers from The Ohio State University discussed the evolution of high-performance networking technologies. At the conference, they explained how efficient distributed computing at such a scale requires considerably more than faster network connections, highlighting the importance of scale across domains to stretch workloads across different data centers in separate geographical regions.

Massive systems call for new interconnects

Modern AI clusters typically accommodate more than 100,000 AI accelerators and potentially millions of CPU endpoints, placing tremendous demands on network bandwidth, latency, and congestion management. Meanwhile, an accelerator's computational performance continues to increase faster than communication capabilities, which means that faster AI GPUs do not necessarily deliver proportional improvements in application performance. …

You're reading a preview. The full article is published by Tom's Hardware on their website.

Read the full story on Tom's Hardware