Artificial Intelligence

The Real Cost of Scaling AI: How Supermicro and NVIDIA Are Rebuilding Data Center Infrastructure

The hidden cost of scaling AI: infrastructure, energy, and the push for liquid cooling.

Updated

January 8, 2026 6:31 PM

The inside of a data centre, with rows of server racks. PHOTO: FREEPIK

As artificial intelligence models grow larger and more demanding, the quiet pressure point isn’t the algorithms themselves—it’s the AI infrastructure that has to run them. Training and deploying modern AI models now requires enormous amounts of computing power, which creates a different kind of challenge: heat, energy use and space inside data centers. This is the context in which Supermicro and NVIDIA’s collaboration on AI infrastructure begins to matter.

Supermicro designs and builds large-scale computing systems for data centers. It has now expanded its support for NVIDIA’s Blackwell generation of AI chips with new liquid-cooled server platforms built around the NVIDIA HGX B300. The announcement isn’t just about faster hardware. It reflects a broader effort to rethink how AI data center infrastructure is built as facilities strain under rising power and cooling demands.

At a basic level, the systems are designed to pack more AI chips into less space while using less energy to keep them running. Instead of relying mainly on air cooling—fans, chillers and large amounts of electricity, these liquid-cooled AI servers circulate liquid directly across critical components. That approach removes heat more efficiently, allowing servers to run denser AI workloads without overheating or wasting energy.

Why does that matter outside a data center? Because AI doesn’t scale in isolation. As models become more complex, the cost of running them rises quickly, not just in hardware budgets, but in electricity use, water consumption and physical footprint. Traditional air-cooling methods are increasingly becoming a bottleneck, limiting how far AI systems can grow before energy and infrastructure costs spiral.

This is where the Supermicro–NVIDIA partnership fits in. NVIDIA supplies the computing engines—the Blackwell-based GPUs designed to handle massive AI workloads. Supermicro focuses on how those chips are deployed in the real world: how many GPUs can fit in a rack, how they are cooled, how quickly systems can be assembled and how reliably they can operate at scale in modern data centers. Together, the goal is to make high-density AI computing more practical, not just more powerful.

The new liquid-cooled designs are aimed at hyperscale data centers and so-called AI factories—facilities built specifically to train and run large AI models continuously. By increasing GPU density per rack and removing most of the heat through liquid cooling, these systems aim to ease a growing tension in the AI boom: the need for more computers without an equally dramatic rise in energy waste.

Just as important is speed. Large organizations don’t want to spend months stitching together custom AI infrastructure. Supermicro’s approach packages compute, networking and cooling into pre-validated data center building blocks that can be deployed faster. In a world where AI capabilities are advancing rapidly, time to deployment can matter as much as raw performance.

Stepping back, this development says less about one product launch and more about a shift in priorities across the AI industry. The next phase of AI growth isn’t only about smarter models—it’s about whether the physical infrastructure powering AI can scale responsibly. Efficiency, power use and sustainability are becoming as critical as speed.

Keep Reading

Operations & Scale

TECO Acquires Malaysian Engineering Firm to Expand Modular AI Data Center Business

The US$50.8 million deal strengthens TECO’s push into modular infrastructure and faster data center deployment across Southeast Asia.

Updated

May 26, 2026 5:39 PM

Kuala Lumpur, Malaysia. PHOTO: UNSPLASH

TECO Electric & Machinery is expanding further into Southeast Asia’s AI data center infrastructure market through a new acquisition in Malaysia.

The Taiwan-based company has signed an agreement to acquire approximately 78 percent of Malaysian engineering firm Dynaciate Engineering in a deal valued at around MYR 200 million (US$50.8 million). According to TECO, the acquisition is aimed at strengthening its modular data center manufacturing capabilities and supporting its expansion across Southeast Asia’s data center infrastructure sector.

Under the agreement, Dynaciate will become TECO’s global manufacturing hub for modular data center and power equipment products. The company will also serve as an engineering hub supporting TECO’s regional expansion efforts, particularly in AI data center infrastructure projects.

TECO Chairman Morris Li said the integration between both companies has improved execution efficiency and increased the company’s in-house modular prefabrication capabilities. According to the company, the collaboration has reduced data center delivery timelines to as little as six months.

Dynaciate is headquartered in Johor Bahru, Malaysia. Its facilities span approximately 36,000 square meters and include eight production buildings focused on stainless steel and carbon steel fabrication. The company said the site is also eligible for export tax incentives that support future global supply chain deployment.

According to TECO, Dynaciate has experience in engineering, steel fabrication and large-scale industrial projects for multinational corporations. The company added that Dynaciate has expanded into the data center engineering market since 2025 through projects involving international cloud service provider clients.

TECO estimates that after the acquisition, around 65 percent of future data center-related revenue will come from modular data centers and prefabricated products, while the remaining 35 percent will come from AI data center engineering projects. The company also forecasts that data center-related revenue within its Power & Energy Business Group will rise from below 10 percent to 30 percent this year.

Dynaciate CEO Ng Kim Thiea said the company is entering a new phase of growth through the partnership with TECO. He added that Dynaciate has extensive experience supporting engineering and industrial projects across the region.

The acquisition marks a further expansion of TECO’s presence in the AI data center infrastructure sector as companies continue increasing investments in modular infrastructure and regional engineering capacity.