AI/HPC has Completely Caught the Data Center Industry Off-Guard

Liquid Cooled Racks
AI/HPC workloads have caught the data center industry off-guard in terms of more efficient data center cooling & shift to tertiary markets

In a recent article for Mission Critical magazine, Sara Martin, associate principal at HED highlighted her three data center predictions for 2024. Two of these predictions I have been deeply involved with solving; (1) Better, more efficient data center cooling; and (2) Data centers will shift to tertiary markets. Indeed, AI and HPC workloads are driving both predictions. It is amazing to me that for all this market’s sophistication, AI/HPC has completely caught the data center industry off-guard.

As we navigate the evolving AI/HPC landscape, two strategies appear particularly promising: 

  1. Hybrid Liquid/Air Cooling: Currently, at least half of the data center environment INTUVA is designing and building are for AI/HPC workloads where rack densities vary from 10kW, to as high as 90kW. This wide power density disparity gives rise to the need for an elegant and well-engineered hybrid liquid- and air-cooled solution. As such, the industry is awash with an array of competing strategies and products with respect to chillers, dry coolers, room/rack CDUs, and room-based air-conditioners, as well as rack-based liquid- and air-cooling systems. 
      
  2. The Evolution of the Near-Edge Data Center Market: A transition in computing from discrete-time AI model training to real-time, continuous AI modeling—a topic I recently discussed in my presentation at Data Center World in Washington, DC: “Construction Design for a Generator-less Future”, will eventually shift data center infrastructures from centralized locations (think NFL and NCAA cities) to a highly distributed “near edge” model (think High School cities). This will both alleviate the strain on power resources of the centralized markets and enhance data processing speeds and user experience by bringing data closer to the end-user. 
Liquid Cooled Racks

At INTUVA, we are at the forefront of designing and constructing adaptable data centers that meet these emerging needs across various geographical and industrial landscapes. In fact, we specialize in integrating power-dense servers, including liquid-cooled racks, into colocation and edge data centers, ensuring optimal performance for AI and high-performance computing applications. Meanwhile, GRID7 Energy is pioneering the transformation of power solutions for critical facilities. Our innovative approach includes the deployment of natural gas linear generators, solid-state fuel cells, and renewable energy sources such as solar, wind, and battery energy storage systems (BESS). 

Together, INTUVA and GRID7 are not just anticipating the future needs of data centers but actively shaping them, ensuring our clients are prepared for a landscape where power availability and efficiency are paramount. 

For more information on how we can help your organization stay ahead of the curve in data center design and energy solutions, visit INTUVA Solutions and GRID7 Energy. 

Share the Post:

Related Posts

Join Our Newsletter