Nvidia says its AI data center design runs hotter to use a lot less water

Public pushback against data centers has emphasized their water and energy consumption, and now Nvidia is highlighting its claim that the Rubin generation reference design for a fully liquid-cooled data center has “eliminated massive amounts of power usage and pretty much all water usage.” Still, it doesn’t address all of the concerns around AI data centers, including during their construction, and for the power generation requirements of the massive facilities. Also, as Gizmodo points out, Nvidia’s blog post doesn’t mention the cost of building this style of data center vs. one using less efficient air cooling, but claims that “every cloud provider and data center operator building for [Rubin] is making the transition.”

The efficiency gains are partly due to running AI servers hotter, as high as 113 degrees Fahrenheit (45 degrees Celsius). In a recent report, Amazon similarly touted higher heat tolerances as part of making its mostly air-cooled data centers more efficient.

With Nvidia’s system, “heat is captured directly at the chip and transported through liquid loops operating at much higher temperatures, allowing outdoor dry coolers to reject heat efficiently for much of the year,” with much more flexibility when it comes to the ambient air temperature.

According to Nvidia’s head of sustainability, Josh Parker, the reference design takes water use “from roughly 2.6 million gallons per megawatt per year for conventional cooling-tower-based systems to near zero — up to a 100 percent reduction.”