IBM used AMD’s other not-so-secret weapon to deliver yet another brain-like chip — NorthPole is faster and uses less energy than Nvidia’s best AI GPU and it’s only the beginning
IBM’s NorthPole is 25-times more efficient than the best GPUs and the best CPUs out there
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
IBM’s NorthPole chip – nearly ten years in the making – is going from strength to strength and achieved a new milestone with researchers publishing a set of fantastic benchmarking results in the journal Science.
The 12nm chip, built on the TrueNorth architecture, is 25-times more power efficient than commonly used 12nm GPUs and 14nm CPUs. This is according to testing on the ResNet-50 model, and was measured as the number of frames interpreted per joule of power.
NorthPole is also much better in terms of latency and space required to compute, and outperofrms all major architectures, including a GPU implemented using a 4nm process, according to IBM.
Melding computing power with memory
How does it manage to achieve such results? The memory is on the chip itself rather than connected separately – embedded in each of the 256 cores on the chip. NorthPole also comprises 22 billion transistors, and its cores can perform 2,048 operators per core.
Its architecture eliminates the Von Neumann bottleneck, according to the firm, which revolves around the delays caused by the need for data to travel between the CPU and RAM in most systems. As a result, it can perform much faster than thebest GPUsout there, including the best AI-centric graphics cards byNvidia.
“Architecturally, NorthPole blurs the boundary between compute and memory,” said IBM Research’s Dharmendra Modha. “At the level of individual cores, NorthPole appears as memory-near-compute and from outside the chip, at the level of input-output, it appears as an active memory.”
AMDhas also tapped into the concept of combining memory and compute on a single component. Building on the theme of processor-in-memory (PIM),Xilinx showcased its Virtex XCVU7P card last month, which had eight accelerator-in-meomry (AiM) modules.
Are you a pro? Subscribe to our newsletter
Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed!
IBM, which adds memory to each compute core in its NorthPole chip, sees this component as perfect for emerging AI use cases, including computer vision-related uses. It was also tested on natural language processing and speech recognition. NorthPole is also suited to edge applications that require massive amounts of data processing in real-time.
More from TechRadar Pro
Keumars Afifi-Sabet is the Technology Editor for Live Science. He has written for a variety of publications including ITPro, The Week Digital and ComputerActive. He has worked as a technology journalist for more than five years, having previously held the role of features editor with ITPro. In his previous role, he oversaw the commissioning and publishing of long form in areas including AI, cyber security, cloud computing and digital transformation.
Workers feel “trapped” with poor CRM tools, want an AI upgrade
This new Microsoft Teams update might finally make it easier to find the people you’re looking for
Zenless Zone Zero Version 1.3 adds two new playable agents, new story content, and special events
