Chip designer Arm has entered the artificial intelligence (AI) hardware market with its first in-house processor, the AGI CPU, specifically built to power advanced AI agents. These agents are sophisticated systems capable of proactive action, requiring less human oversight than traditional chatbots.
Arm announced the AGI CPU features a custom design utilizing 3-nanometer process nodes and up to 136 Neoverse V3 cores, reaching 3.7 GHz clock speeds with 6 gigabytes per second of memory bandwidth per core. This design targets data centers powering active AI agents, aiming for superior performance and efficiency compared to traditional x86 architecture CPUs.
The AGI CPU leverages the Armv9.2-A architecture, optimized for AI inference. This specialized design eliminates the need for legacy support found in general-purpose CPUs, promising faster and more efficient AI operations. Arm claims the AGI CPU delivers over double the performance per server rack compared to x86 CPUs.
Each AGI CPU blade contains two chips with dedicated memory and I/O, totaling 272 cores. Stacking these into racks of 30 creates a configuration with 8,160 cores, designed for massive-scale agentic AI workloads.
Arm's established expertise in providing strong performance with lower power consumption, evident in smartphone processors, positions it well for this AI hardware push. As AI transitions from training large language models to deploying active agents, the demand for CPU processing power in data centers is expected to surge.
This custom-designed hardware aims to overcome scalability constraints in AI operations, potentially disrupting traditional data center computing and accelerating progress toward artificial general intelligence (AGI).