The hidden cost of scaling AI: infrastructure, energy, and the push for liquid cooling.
Updated
January 8, 2026 6:31 PM
The inside of a data centre, with rows of server racks. PHOTO: FREEPIK
As artificial intelligence models grow larger and more demanding, the quiet pressure point isn’t the algorithms themselves—it’s the AI infrastructure that has to run them. Training and deploying modern AI models now requires enormous amounts of computing power, which creates a different kind of challenge: heat, energy use and space inside data centers. This is the context in which Supermicro and NVIDIA’s collaboration on AI infrastructure begins to matter.
Supermicro designs and builds large-scale computing systems for data centers. It has now expanded its support for NVIDIA’s Blackwell generation of AI chips with new liquid-cooled server platforms built around the NVIDIA HGX B300. The announcement isn’t just about faster hardware. It reflects a broader effort to rethink how AI data center infrastructure is built as facilities strain under rising power and cooling demands.
At a basic level, the systems are designed to pack more AI chips into less space while using less energy to keep them running. Instead of relying mainly on air cooling—fans, chillers and large amounts of electricity, these liquid-cooled AI servers circulate liquid directly across critical components. That approach removes heat more efficiently, allowing servers to run denser AI workloads without overheating or wasting energy.
Why does that matter outside a data center? Because AI doesn’t scale in isolation. As models become more complex, the cost of running them rises quickly, not just in hardware budgets, but in electricity use, water consumption and physical footprint. Traditional air-cooling methods are increasingly becoming a bottleneck, limiting how far AI systems can grow before energy and infrastructure costs spiral.
This is where the Supermicro–NVIDIA partnership fits in. NVIDIA supplies the computing engines—the Blackwell-based GPUs designed to handle massive AI workloads. Supermicro focuses on how those chips are deployed in the real world: how many GPUs can fit in a rack, how they are cooled, how quickly systems can be assembled and how reliably they can operate at scale in modern data centers. Together, the goal is to make high-density AI computing more practical, not just more powerful.
The new liquid-cooled designs are aimed at hyperscale data centers and so-called AI factories—facilities built specifically to train and run large AI models continuously. By increasing GPU density per rack and removing most of the heat through liquid cooling, these systems aim to ease a growing tension in the AI boom: the need for more computers without an equally dramatic rise in energy waste.
Just as important is speed. Large organizations don’t want to spend months stitching together custom AI infrastructure. Supermicro’s approach packages compute, networking and cooling into pre-validated data center building blocks that can be deployed faster. In a world where AI capabilities are advancing rapidly, time to deployment can matter as much as raw performance.
Stepping back, this development says less about one product launch and more about a shift in priorities across the AI industry. The next phase of AI growth isn’t only about smarter models—it’s about whether the physical infrastructure powering AI can scale responsibly. Efficiency, power use and sustainability are becoming as critical as speed.
Keep Reading
HSUHK’s award-winning system shows how AI, drones and AR can cut training time, reduce errors and reshape warehouse operations
Updated
March 30, 2026 2:29 PM
Dji Mavic Mini 2 drone. PHOTO: ADOBE STOCK
As global tech ecosystems become more interconnected, the ability to move innovation across borders is becoming just as important as building it. A new partnership between MTR Lab, the investment arm of MTR Corporation and ZGC Science City Ltd, a government-backed technology ecosystem based in Beijing’s Haidian district, reflects this shift.
At its core, the collaboration is designed to connect high-potential Chinese startups with global capital, real-world deployment opportunities and international markets. It focuses on sectors like AI, robotics, smart mobility and sustainable urban development—areas where China already has strong technical depth but where scaling beyond domestic markets can be more complex.
This is where the partnership begins to matter. ZGC Science City sits at the center of one of China’s most concentrated innovation clusters, with thousands of AI companies and a growing base of specialised and high-growth firms. MTR Lab, on the other hand, brings access to international markets, industry networks and practical deployment environments tied to infrastructure, transport and urban systems. Together, they are attempting to bridge a familiar gap: turning local innovation into globally relevant products.
In practice, the model is straightforward. ZGC Science City will introduce MTR Lab to startups working in priority sectors, creating a pipeline for potential investment and collaboration. From there, MTR Lab can support these companies through funding, pilot projects and access to overseas markets. The idea is not just to invest, but to help startups test and apply their technologies in real-world settings, particularly in complex urban environments.
The timing is notable. China’s AI and deep tech ecosystem has expanded rapidly, with thousands of companies contributing to advancements in automation, smart infrastructure and sustainability. At the same time, global demand for these technologies is rising, especially as cities look for more efficient and scalable solutions. Yet, moving from innovation to adoption often requires cross-border coordination—something individual startups may struggle to navigate alone.
This partnership also builds on a broader pattern. Corporate venture arms like MTR Lab are increasingly positioning themselves not just as investors, but as connectors between markets. By combining capital with access to infrastructure and deployment scenarios, they offer startups a way to move faster from development to real-world use. For ZGC Science City, the collaboration adds an international layer to its ecosystem, helping local companies extend beyond domestic growth.
What emerges is a model that goes beyond a typical investment announcement. It reflects a growing recognition that innovation today is rarely confined to one geography. Technologies may be developed in one ecosystem, refined in another and scaled globally through partnerships like this.
As cross-border collaboration becomes more central to how startups grow, partnerships like the one between MTR Lab and ZGC Science City point to a more connected innovation landscape—one where access, not just invention, defines success.