Forward or Backwards

Topics › Computers › Artificial Intelligence

Liquid Cooling: Data Centers' Heat Problem

Published · 14 min

Watch on YouTube

AI chips burn so much power, in so little space, that fans and cold air can no longer carry the heat away. Data centers are going back to an engineering idea the industry mostly abandoned forty years ago: cooling with liquid in direct contact with the hardware.

This video covers why physics makes liquid cooling inevitable once a chip's power density crosses a threshold air cannot reach, and how the two main methods actually work. Direct-to-chip cooling, where a metal cold plate sits on the chip and carries heat away in a loop. Immersion cooling, where whole servers are submerged in non-conductive fluid, either single-phase or two-phase. And the closed-loop systems and coolant distribution units (CDUs) that keep the fluid touching the electronics separate from the building's own water.

It traces the idea back to 1985, when Cray's Cray-2 supercomputer submerged its own circuit boards in Fluorinert — and to the four decades in which mainstream data centers walked away from liquid cooling, until Nvidia's GB200 NVL72 rack, drawing around 132 kilowatts, made liquid cooling mandatory rather than optional.

It covers who is shipping liquid-cooled hardware at scale through 2026 — Nvidia, Supermicro, Vertiv, Submer, UNICOM Engineering and Green Revolution Cooling among them — the tradeoffs operators are weighing (leak risk, retrofit cost, an unsettled fire-safety standard), the debate over water use and where new AI data centers can be sited, and why market and industry estimates for how far the shift has gone disagree so widely, because they measure different things.

Every figure is traced to a named, dated source in the production fact sheet. Two claims from the original research brief did not hold up against primary sources and are corrected here rather than repeated.

Educational documentary. Not financial or investment advice.

In these topics

Chapters

  1. The heat problem
  2. The physics of the limit
  3. An old idea returns
  4. Direct-to-chip cooling explained
  5. Immersion cooling explained
  6. Closed-loop systems and the CDU
  7. Why today's AI racks force the issue
  8. Who is installing it now
  9. The tradeoffs operators weigh
  10. Where data centers can be built
  11. The scale of the shift
  12. What happens next

More from Forward or Backwards on YouTube

Sources and credits

Photo credits (Wikimedia Commons)

Primary sources

  • Uptime Institute Intelligence, 'Immersion fluids hold promise, fire risk a concern', UII Update 264, June 2024 — immersion cooling's limited mainstream adoption, 3M's exit from two-phase fluids, and the lack of an agreed fire-safety standard for single-phase immersion.
  • TrendForce press release, 17 August 2026, 'Liquid Cooling to Reach 53% of High-End AI Infrastructure in 2026', trendforce.com/presscenter — the 2025-2027 AI chip liquid cooling penetration figures.
  • EdgeCore CEO Lee Kestler, interviewed on the Data Center Frontier podcast, published 15 July 2025 — on most data center workloads remaining air-cooled and the operational liquid-cooling path still being unsettled.
  • Global Market Insights, Data Center Liquid Cooling Market report, January 2026 update, gminsights.com — the ~$6 billion 2026 market estimate and 18.2% CAGR to 2035.
  • GlobeNewswire / GRC press release, 10 March 2026, 'UNICOM Engineering and GRC Launch Fully Integrated Immersion Cooled AI Solutions' — the UNICOM-GRC partnership and the GRC ICEraQ Nano installation.
  • Supermicro investor announcement, 5 January 2026, ir.supermicro.com — Supermicro's Vera Rubin liquid-cooling manufacturing expansion. Corrects a brief claim that dated this to March 2026.
  • Vertiv/Nvidia partnership coverage, March 2026 (Nasdaq/Motley Fool, 'Vertiv Is Up 64% in 2026 and Wall Street Says It's Still a Buy', and Vertiv's own news pages) — the DSX SimReady, OneCore and Vera Rubin liquid-cooled system announcements.
  • Submer Group press materials and trade coverage, 28 September 2026 (datacenterdynamics.com, datacentremagazine.com) — the Corenix modular platform launch, built on Nvidia reference designs.
  • Congressional Research Service, 'Data Centers and Water: Frequently Asked Questions' (2026); KXLY News, Airway Heights, Washington coverage (2026); Bloomberg Government, 'Drought-Ravaged Georgia Asks Data Centers to Cut Water Use' (2026) — the water-use siting debate.

Not regulated financial advice.