Next-Generation Chips and Cooling: What to Watch
Chips are using more power in a small space, and that changes cooling. Here is what to watch and how to plan with room to adapt.
Key takeaways
- The trend is more power per chip and per rack, which pushes cooling from air toward liquid.
- Direct to chip and immersion cooling are the main liquid approaches, and each has trade-offs.
- Plan for flexibility, because chip needs may change faster than buildings can.
Newer computer chips, especially those built for artificial intelligence, tend to use more power than earlier generations, and they pack it into a small area. More power in a small space means more heat in a small space. Air alone struggles to carry it away, so liquid cooling is becoming more common. The practical message for planners is to keep options open.
What is changing
- Power per chip. Has generally been rising across recent generations.
- Power per rack. A rack is a standard frame that holds servers. Racks for AI work often draw much more than traditional racks.
- Heat density. The heat per unit of floor area has grown, which strains older designs.
Exact numbers vary by product and change over time, so rely on current supplier data for any real project.
The main cooling approaches
Air cooling
Fans move cool air across equipment. It is familiar and simple. It works well up to a limit, then gets noisy, power hungry and hard to manage.
Direct to chip liquid cooling
Small plates sit on the hottest parts, and liquid flows through them to carry heat away. The liquid then passes to a heat exchanger. Some air cooling is still needed for the remaining components. This approach fits into standard racks and is widely used for high power equipment.
Immersion cooling
Servers sit in a bath of liquid that does not conduct electricity. The liquid absorbs the heat directly. It can handle very high density, but it changes how equipment is serviced and may need special tanks, floor loading checks and supplier approval.
Rear door and in-row units
These bring cooling coils closer to the equipment. They can be a middle step between air and full liquid.
Facility water temperature
Liquid systems often accept warmer water than traditional air systems. That can reduce the need for mechanical chillers in some climates and allow more free cooling, which means using outside conditions to cool. The allowed temperature depends on the chip maker's requirements, so confirm before designing around it.
What to watch
- Supplier roadmaps for power and cooling needs of the next generation.
- Standards for liquid connections, fluids and water quality.
- Reliability of liquid loops, including leak detection and isolation.
- Skills of operating staff, who need training on liquid systems.
- Electrical capacity, since cooling choices do not solve power limits.
Planning with flexibility
- Leave space and structural capacity for piping and extra equipment.
- Design the cooling plant so that it can be expanded in stages.
- Reserve room for heat exchangers and pumps.
- Choose layouts that allow a mix of air cooled and liquid cooled areas.
- Keep electrical and cooling upgrades on separate, planned paths.
Questions to ask
- What power per rack does the design support today, and what could it support with a planned upgrade?
- What water temperature and quality does the equipment require?
- How is a leak detected and contained?
- What happens to warranty if a different cooling method is used?
- Who is responsible for the liquid loop, the owner, the tenant or the equipment supplier?
Training the people who will run the site is easy to overlook. Liquid systems bring new tasks, such as checking fluid quality, testing leak sensors, bleeding air from loops and following safe connection procedures. Operators who know air cooled rooms well will still need time to learn these. Build training and written procedures into the project plan, and schedule drills for leaks before the first real one.
Finally, keep the economics in view. Liquid cooling can reduce fan power and make dense equipment practical, but it adds pumps, piping, heat exchangers and controls. Compare total cost over the life of the site, including maintenance and the cost of changing course, instead of looking only at the first purchase price.
Keep watching standards work and supplier guidance as well. As more sites adopt liquid cooling, common practices for fluids, connections and testing tend to settle, and that makes later projects easier to plan.
Nobody can predict every future chip. A design that can adapt will usually serve better than one tuned tightly to a single generation.
This article is general information for public education. It is not legal, tax, financial or engineering advice. Rules and conditions differ by location, so check with qualified local professionals. Spot an error? Write to info@datacenteroutreach.com and we will correct it.