pwshub.com

As Chinese AI and GPU demand heats up, a Hong Kong data centre turns to liquid cooling

Global Switch, a data centre operator controlled by China's state-backed Jiangsu Sha Steel Group, said demand from mainland artificial intelligence firms in Hong Kong is driving a need for new direct-to-chip cooling solutions it has started providing in the city.

"We've seen a huge increase in demand for higher and higher density racks," said Ben Ryder, solutions engineering director at Global Switch. "In the last two years, we've seen requirements for 20 kilowatts [per rack] initially, 40 to 50, and now beyond that, up to 100 kilowatts, as we can support liquid cooling."

Global Switch on Monday announced the availability of direct-to-chip liquid cooling in its 30-megawatt facility in Tseung Kwan O after last week inviting potential customers in to see what it called the first showcase of this solution in Hong Kong. Direct-to-chip cooling, which involves placing a cold plate with cool liquid running through it in direct contact with integrated circuits, is in increasing demand in data centres as power requirements for AI applications shoot up.

Do you have questions about the biggest topics and trends from around the world? Get the answers with SCMP Knowledge, our new platform of curated content with explainers, FAQs, analyses and infographics brought to you by our award-winning team.

Global Switch's Hong Kong data centre in Tseung Kwan O on November 15, 2017. Photo: Global Switch alt=Global Switch's Hong Kong data centre in Tseung Kwan O on November 15, 2017. Photo: Global Switch>

The company said it has seen an increasing number of inquiries related to deploying China-made graphics processing units (GPUs), the type of chips driving the AI boom. GPUs have become highly politicised as the US moved to block certain powerful chips from Nvidia from being exported to China. This has increased demand in China for AI chips from companies like Huawei Technologies and Shanghai-based unicorn Biren Technology.

Global Switch said it does not have visibility into the tech that customers use in their servers, but power and cooling demands provide some insights.

"In Hong Kong it's very clear that the main new demand comes from mainland China customers," said Eric Liu, the Hong Kong managing director for Global Switch. "I think compared with a couple of years before, they are more open to new markets, and they are bringing out from mainland China their own technology to Hong Kong."

In rolling out its new cooling solutions - which includes rear-door heat exchangers that combine liquid and air cooling - Global Switch has partnered with Supermicro, xFusion and Liquidstack. In its presentation ahead of a tour of the facility on September 10, Supermicro touted the capabilities of its servers running Nvidia's H100 and H200, two of the AI chips that Washington has banned from export to China.

Matthew Dent, Global Switch's chief commercial officer, said the company does not police server hardware in its facilities. No local laws prevent companies from purchasing Nvidia chips, and a black market for the products has sprung up where they sell well above retail price.

"As a data centre operator, we're agnostic," Dent said. "We're not in the business of servers and chips. We're in the business of creating a resilient environment for our customers' equipment."

Founded in the UK in 1998, Global Switch has grown to 13 data centres across eight markets, concentrated in major metropolitan areas.

The company works with major tech companies, including Alibaba Group Holding, the owner of the South China Morning Post. Alibaba Cloud lists the Tseung Kwan O facility as one of its six Hong Kong access points.

Global Switch's China ties have invited scrutiny in recent years. Australian federal government agencies started terminating agreements with the company in 2017 after a Chinese consortium led by Jiangsu Sha Steel Group bought a 49 per cent stake. Through later investments, Jiangsu Sha Steel became the controlling shareholder in 2019.

Global Switch has previously sought a buyer for the company, according to media reports, but no deals have yet to go through. It has separately been shopping around its Australian facility and has been weighing offers this year, according to reports.

The technical area of Global Switch's Hong Kong data centre, with power distribution cabinets along the walls. Photo: Global Switch alt=The technical area of Global Switch's Hong Kong data centre, with power distribution cabinets along the walls. Photo: Global Switch>

Regarding a potential sale, the company said it has a "duty to look at all options that will enable Global Switch to continue its growth plans", but that shareholders remain "highly supportive of our management team".

The company also said it would not "comment on speculation" regarding its Australia facility, and it downplayed the potential risks of the current geopolitical environment. When asked about the Huawei power distribution cabinets throughout the facility, Ryder said the company uses interchangeable hardware from multiple vendors.

Power distribution cabinets, which distribute power from generators to electrical equipment, are less likely to be politicised because they are a "dumb piece of equipment" without any "intelligence or control", Dent said.

Submarine cables have already become politicised, as Facebook discovered in 2021 when it nixed a plan to connect the US and Hong Kong with a new line. While Global Switch touts its Tseung Kwan O facility as being close to "major submarine cable landing stations", Dent said the company just goes wherever there is client demand.

"The politics of submarine codes is not something we involve ourselves in," he said.

This article originally appeared in the South China Morning Post (SCMP), the most authoritative voice reporting on China and Asia for more than a century. For more SCMP stories, please explore the SCMP app or visit the SCMP's Facebook and Twitter pages. Copyright © 2024 South China Morning Post Publishers Ltd. All rights reserved.

Copyright (c) 2024. South China Morning Post Publishers Ltd. All rights reserved.

Source: finance.yahoo.com

Related stories
3 weeks ago - A flurry of new artificial intelligence models this week illustrated what’s coming next in AI: smaller language models targeted at vertical industries and functions. Both Nvidia and Microsoft debuted smaller large language models too....
3 weeks ago - Nvidia reported Q2 earnings that largely beat analysts' estimates, but the stock slid after forecasted revenue failed to top the high end of expectations.
1 month ago - Intel Corp. said today it’s looking to leverage the growing demand for artificial intelligence in the automotive industry, launching its first-ever discrete graphics processing unit for autonomous and intelligent cars at a special event...
3 weeks ago - When your stock has been called “the most important on planet Earth” by Goldman Sachs Group, it’s hard to exceed expectations. That’s the challenge Nvidia Corp. encountered today when it announced 122% growth in second-quarter revenue and...
3 days ago - Shares of Broadcom (NASDAQ: AVGO), Taiwan Semiconductor Manufacturing (NYSE: TSM), and Arm Holdings (NASDAQ: ARM) were down 3.3%, 2.5%, and 4.3% on...
Other stories
17 minutes ago - (Reuters) -Nike said on Thursday that former senior executive Elliott Hill will rejoin the company to succeed John Donahoe as president and CEO, as the sportswear giant shakes up its top rank amid efforts to revive sales and battle rising...
17 minutes ago - Trump maintains a roughly 60% stake in Trump Media & Technology Group, which trades on the Nasdaq under the ticker symbol "DJT."
17 minutes ago - FedEx and other transportation firms expanded operations during the pandemic-fueled online shipping boom. The company has been trying to cut billions in overhead costs after demand normalized. In June, FedEx completed a restructuring...
17 minutes ago - On CNBC's “Mad Money Lightning Round,” Jim Cramer said Wells Fargo & Company (NYSE:WFC) is going to go higher, adding that it's a “winner.” On Sept. 17, the San Francisco-based bank launched specialized Application Programming Interfaces...
17 minutes ago - Wall Street has absorbed the Fed's message that a deep cut will prove positive for the economy.