Apple unleashes a swarm of Mac Minions to share GPU resources for large AI tasks

In an effort to give its employees better access to GPU resources for inference tasks, Apple has rounded up its Minions, not the animated yellow creatures, but a distributed system that puts idle GPUs across its Macs to work on AI workloads. Apple researchers describe it as "a dynamic and distributed virtual GPU cloud that aggregates idle Apple Silicon GPUs across macOS devices to execute large-scale machine learning inference workloads." Apple's researchers said the company has used Minions to make GPU compute more readily available to its teams. "Prior to its adoption, some inference jobs experienced queue times exceeding ten hours due to limited centralized GPU availability," the paper on Minions explains. "With Minions, tasks can often begin execution within minutes by leveraging idle macOS devices." Apple's recently released Mac mini and Mac Studio support clustering using RDMA (Remote Direct Memory Access) over Thunderbolt 5, allowing compute and memory to be combined to support a single AI workload. …