Skip to main content
  1. Home
  2. Computing
  3. News

Samsung adds A.I. processing to double high-bandwidth memory speeds

By

High-bandwidth memory, or HBM, is already fast. But Samsung wants to make it even faster. The South Korean-based technology giant has announced its HBM-PIM architecture, which will double the speeds of high-bandwidth memory by leaning on artificial intelligence.

Recommended Videos

PIM, which stands for processor-in-memory, leverages the capabilities of artificial intelligence to speed up memory, and Samsung hopes that its HBM-PIM tech will be used in applications such as data centers and high-performance computing (HPC) machines in the future.

Related

“Our groundbreaking HBM-PIM is the industry’s first programmable PIM solution tailored for diverse A.I.-driven workloads such as HPC, training, and inference,” Kwangil Park, Samsung Electronics senior vice president of memory product planning, said in a statement. “We plan to build upon this breakthrough by further collaborating with A.I. solution providers for even more advanced PIM-powered applications.”

Image used with permission by copyright holder

A potential client for Samsung’s HBM-PIM is the Argonne National Laboratory, which hopes to use the technology to solve “problems of interest.” The lab noted that HBM-PIM addresses the memory bandwidth and performance challenges for HPC and AI computing by delivering impressive performance and power gains.

According to Samsung, the HBM-PIM works by placing a DRAM-optimized engine inside each memory bank in a storage subunit to enable parallel processing to minimize data movement.

“When applied to Samsung’s existing HBM2 Aquabolt solution, the new architecture is able to deliver over twice the system performance while reducing energy consumption by more than 70%,” the company stated. “The HBM-PIM also does not require any hardware or software changes, allowing faster integration into existing systems.”

This is different than existing applications, which are all based on the von Neumann architecture. In current solutions, a separate processor and separate memory units are needed to carry out all the data processing tasks in a sequential approach. This requires data to travel back and forth, often resulting in a bottleneck when handling large data volumes.

By removing the bottleneck, Samsung’s HBM-PIM can be a useful tool in a data scientist’s arsenal. Samsung claims that the HBM-PIM is now being tested by A.I. accelerators by leading A.I. solution partners, and validation is expected to be completed in the first half of 2021.

Editors’ Recommendations

Topics
Chuong Nguyen
Chuong Nguyen
Former Digital Trends Contributor
Silicon Valley-based technology reporter and Giants baseball fan who splits his time between Northern California and Southern…
Intel’s new Core Ultra 9 285K may struggle against its predecessor
Intel's 14900K CPU socketed in a motherboard.

Intel Arrow Lake processors are here, and the Core Ultra 9 285K stands at the top of the lineup as Intel's current best CPU. However, the chip faces a lot of competition not just from AMD, but also from Intel's own last-gen Raptor Lake refresh. Even Intel itself can't deny that performance-wise, the Core Ultra 9 285K and the Core i9-14900K are not that far off.

Although the performance uplift might be subtle (or even non-existent) at times, Intel's Core Ultra 9 285K does bring some interesting changes. Here's a rundown of how the Core Ultra 9 285K and the Core i9-14900K stack up against each other.
Pricing and availability

Read more
Apple is hoping to one-up Meta with its own smart glasses
Person wearing Meta Orion smart glasses.

Apple has been stuck in an innovation rut for the past few years. Aside from the Vision Pro headset — which expectedly didn’t gain a mass reception — the company hasn’t made any notable hardware strides apart from its bread-and-butter mobility and computing portfolio. That could change in the next few years.

According to Bloomberg, Apple’s Vision Pro team is working on smart glasses to tackle the challenge presented by a resurgent Meta. The social media giant has already scored an early lead with the well-received Meta Ray-Ban smart glasses, which have steadily received meaningful social and AI upgrades.

Read more
The Intel Core Ultra 9 285K is already facing an uphill battle
Intel Core Ultra 9 285K CPU box packaging.

The consensus during the launch of a new PC hardware component is that it is faster or more powerful compared to the outgoing model or competition. But that may not be the case with Intel’s latest Arrow Lake-S CPUs. The first crop of Intel’s Core Ultra 200S desktop processors was officially unveiled yesterday and features five new SKUs led by the Core Ultra 9 285K.

By itself, the latest flagship is a very capable chip, but Intel says it is (in most cases) on par with last-gen’s Core i9-14900K. The catch here is that the entire Arrow Lake-S lineup consumes less power, thus generating less heat. That is great news for general consumers and enthusiasts who are particularly worried about high electricity costs and thermal management.

Read more