$60M AI Cluster: 10,000 Nvidia GPUs for sale on eBay
Forget the idea that massive artificial intelligence conglomerates have to hoard the best gear. If you had a cool sixty million dollars sitting around today, you could acquire an entire supercomputer cluster, complete with thousands of cutting-edge processors. This isn’t science fiction; it’s the current reality of the AI hardware arms race.
A recent listing surfaced for a staggering cluster of servers, featuring 300 racks packed with high-end components. This massive setup includes 9,600 Nvidia A100 GPUs and 4,200 AMD EPYC CPUs.
Breaking down the components, each rack is a powerhouse, equipped with eight Nvidia A100 40 GB GPUs, eight Nvidia Connect network interface cards, and two AMD EPYC 64-core CPUs. On top of that, each rack packs 1 TB of DDR4 memory, creating an astonishing total of 1.4 petabytes of memory across the entire setup.
The sheer computational muscle housed in this cluster is immense. The Nvidia A100 GPU, a specialized chip built on the Ampere architecture, is specifically designed for demanding AI workloads, offering 6912 CUDA cores each—far exceeding what is typically needed for standard gaming or everyday computing.
This ambitious collection of hardware, which represents an enormous investment by major tech players, garnered attention when it was listed for sale. The total valuation for this 300-rack behemoth reached $59.7 million.
While the listing is closed, the scale of this endeavor puts into perspective the colossal spending required to fuel the current AI boom. It highlights just how much memory—and thus, how costly computing power—AI companies are pouring into their infrastructure.
When you consider the cost of just the RAM alone, these AI servers truly put into perspective the economic forces driving the digital revolution. It shows how these companies are battling each other, investing billions to gain the upper hand in the increasingly competitive world of artificial intelligence.