pwshub.com

Fujitsu introduces dynamic resource allocator for AI servers and HPC systems

Serving tech enthusiasts for over 25 years.
TechSpot means tech analysis and advice you can trust.

Forward-looking: Fujitsu's business has traditionally focused on selling computing products, mainframe servers, and HPC devices. Now, the company is aiming to leverage its "computational optimization expertise" to offer innovative, software-based solutions to address the growing demand for GPUs in cutting-edge AI applications.

After introducing its "computing broker" solution in 2023, Fujitsu has now confirmed that the product is finally available for purchase in Japan and other markets worldwide. The Kawasaki-based corporation aims to achieve through software what has traditionally been handled by hardware, which is expected to significantly improve resource optimization and GPU utilization.

The new technology is presented as middleware designed to dynamically allocate resources on a per-GPU basis, optimizing utilization and advanced memory management across multiple platforms and AI applications. The computing broker allocates CPU and GPU computing resources in real-time, prioritizing processes with higher execution efficiency. It can also reallocate processes even while they are already running on a GPU.

In pre-release testing, Fujitsu reportedly achieved up to a 2.25x improvement in GPU processing performance. The technology also offers impressive memory management capabilities, as it is designed to handle AI workloads of up to 150GB – around five times the physical memory capacity of the tested GPUs.

Fujitsu initially stated that developers needed to use its proprietary framework to fully exploit the capabilities of the new computing broker technology. However, the latest announcement makes no mention of this requirement. The company is now working to further enhance the technology, aiming to support multiple GPUs installed across multiple servers in data center environments.

Fujitsu said that various companies have been testing the computing broker middleware since May 2024. Tradom, a Japanese fintech venture, has reportedly implemented the technology in production, while cloud provider Sakura is evaluating its potential for optimizing data center operations.

Fujitsu emphasizes the value of resource optimization in reducing the energy consumption of GPU-based AI applications. With generative AI services continuing to dominate the tech landscape, enterprise-grade GPUs remain among the most in-demand hardware components. The company suggests that making these systems operate more efficiently is crucial for addressing the growing demand.

Source: techspot.com

Related stories
2 weeks ago - Can handle edge inferencing or run a 64 display command center GPU-enhanced servers can typically pack up to eight of the accelerators, but Supermicro has built a box that manages to fit 18 of them inside an air-cooled chassis that'll eat...
1 day ago - Middleware aimed at softening the shortage of AI accelerators Fujitsu has started selling middleware that optimizes the use of GPUs, so that those lucky enough to own the scarce accelerators can be sure they're always well-used.…
1 month ago - Fujitsu recently announced a slew of new PCs. The products include nine Lifebook notebook models, three Esprimo desktops, two Stylistic tablets, and two high-end Celsius workstations. All models are preinstalled with Windows 11 and have...
2 weeks ago - Japanese IT corporation Fujitsu and US server manufacturer Supermicro have teamed up to develop a new data center platform designed for AI applications. The technology will be based on Fujitsu's Monaka, a novel Arm-based processor...
1 month ago - Broadcom's software bundles under scrutiny after perhaps irking Fujitsu Japan's Fair Trade Commission, the nation's anti-monopoly agency, has reportedly commenced an investigation into VMware's software licensing practices.…
Other stories
3 minutes ago - Who doesn't love abusing buggy appliances, really? Cisco has patched an already exploited security hole in its Adaptive Security Appliance (ASA) and Firepower Threat Defense (FTD) software that miscreants have been brute-forcing in...
9 minutes ago - Reviews of the best espresso machines of the year based on our extensive testing. Here are our favorite models from top-rated brands like Breville, Cuisinart and more.
9 minutes ago - It's the time of year that Medicare and Medicare Advantage plans are open for new signups and changes. You'll need to act now for 2025 health care coverage.
9 minutes ago - Take an impressive $30 off these JLab headphones at Best Buy, dropping them to just 50 bucks.
9 minutes ago - We've tested several juicers from the biggest brands to help you find the best for you. Here's what you need to know to make fresh juice at home.