Skip to main content

Samsung adds A.I. processing to double high-bandwidth memory speeds

 

High-bandwidth memory, or HBM, is already fast. But Samsung wants to make it even faster. The South Korean-based technology giant has announced its HBM-PIM architecture, which will double the speeds of high-bandwidth memory by leaning on artificial intelligence.

Recommended Videos

PIM, which stands for processor-in-memory, leverages the capabilities of artificial intelligence to speed up memory, and Samsung hopes that its HBM-PIM tech will be used in applications such as data centers and high-performance computing (HPC) machines in the future.

“Our groundbreaking HBM-PIM is the industry’s first programmable PIM solution tailored for diverse A.I.-driven workloads such as HPC, training, and inference,” Kwangil Park, Samsung Electronics senior vice president of memory product planning, said in a statement. “We plan to build upon this breakthrough by further collaborating with A.I. solution providers for even more advanced PIM-powered applications.”

Image used with permission by copyright holder

A potential client for Samsung’s HBM-PIM is the Argonne National Laboratory, which hopes to use the technology to solve “problems of interest.” The lab noted that HBM-PIM addresses the memory bandwidth and performance challenges for HPC and AI computing by delivering impressive performance and power gains.

According to Samsung, the HBM-PIM works by placing a DRAM-optimized engine inside each memory bank in a storage subunit to enable parallel processing to minimize data movement.

“When applied to Samsung’s existing HBM2 Aquabolt solution, the new architecture is able to deliver over twice the system performance while reducing energy consumption by more than 70%,” the company stated. “The HBM-PIM also does not require any hardware or software changes, allowing faster integration into existing systems.”

This is different than existing applications, which are all based on the von Neumann architecture. In current solutions, a separate processor and separate memory units are needed to carry out all the data processing tasks in a sequential approach. This requires data to travel back and forth, often resulting in a bottleneck when handling large data volumes.

By removing the bottleneck, Samsung’s HBM-PIM can be a useful tool in a data scientist’s arsenal. Samsung claims that the HBM-PIM is now being tested by A.I. accelerators by leading A.I. solution partners, and validation is expected to be completed in the first half of 2021.

Chuong Nguyen
Silicon Valley-based technology reporter and Giants baseball fan who splits his time between Northern California and Southern…
Buy a Samsung G6 or G9 gaming monitor and get a free JBL gaming headset
Kena Bridge of Spirits on the Samsung Odyssey OLED G9.

If your gaming PC setup needs a screen upgrade, we highly recommend taking a look at Samsung monitor deals. There are always some huge savings available for the brand's gaming monitors, and we've picked out two of them for you to consider. The 27-inch Samsung Odyssey OLED G6 gaming monitor is on sale for $700 following a $200 discount on its original price of $900, while the 49-inch Samsung Odyssey OLED G9 gaming monitor is down to $1,000 for savings of $800 on its sticker price of $1,800.

No matter which of these two displays you choose, you'll get the JBL Quantum One gaming headset -- featuring active noise cancellation, head-tracking 3D audio, epic audio quality, and an ergonomic design with a regular price of $200 -- for absolutely free. You're going to have to hurry with your purchase though, as there's no telling how much time is remaining until the price cuts and the offer for the free gaming headset expire.

Read more
This Alienware x16 R2 gaming laptop with RTX 4080 is $700 off today
The Alienware x16 R2 gaming laptop with Evil Dead The Game on the screen.

You need to be ready to spend a lot of money if you want a powerful gaming laptop, but you should also be on the lookout for opportunities at huge savings from gaming laptop deals. Here's an offer that serious gamers should consider: the Alienware x16 R2 with the Nvidia GeForce RTX 4080 graphics card at $700 off from Dell, bringing its price down from $3,200 to $2,500. It's still pretty expensive, but you can't ignore that massive discount. This is a clearance sale though, so you need to hurry with your purchase because stocks of the gaming laptop may already be running low.

Why you should buy the Alienware x16 R2 gaming laptop

Read more
This compact HP Omen gaming PC is on sale at 39% off today
The HP Omen 16L gaming desktop sitting on a desk.

For those who want a proper gaming desktop but don't have enough space for a big and bulky machine, the HP Omen 16L could be what you need. You're in luck because it's on sale from the gaming PC deals of HP right now, with this configuration featuring the Nvidia GeForce RTX 3050 graphics card available at 39% off. You'll only have to pay $800 instead of its original price of $1,330, but you need to push through with your purchase immediately if you want to make sure you pocket the savings of $530.

Why you should buy the HP Omen 16L gaming PC

Read more